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^ , - Spring 197A 

Mathematics Education Research Studies Reported i^( Research 

in Education (January - March, 19 74) "TTT 1 

/ • . ' • - . . . . 

MatTiematics Education Research Studied Reported in Journals 

as Indexed by CUE (January - March, 1974) ; . ^ . . \ j 

Brigh't,^ George W/; Carry, L. Ray. The Influence of 'professional 

Reference Groups on Decisions of Presei;yice Secondary School ' . 
Mathematics Teachers. Journal 'for Research in Mathematics - ' ' 
Education . v5 n2, pp87-97, March 1974*. \ 
Abstracted by THOMAS J. COONEY. ....... 9 

ahan, Leroy G. ; Robinson, Mary L. Task-Analysis Procedures in 
Mathematics Instruction of Achievers ^nd Underacliievers. School 
Science and Mathematics, v73 n7, pp578-584, October 1973 ' 

Abstracted by MARY ANW BYRNE , .'l3 

Cathcart, W. George; Liedtke, Werner W. Role of Conceptual Tempo > ' 
in Con$:ept Formation. Alberta Journal of Edu<?ational Re search. 

vl9 n3, pp216-223, Septeniier 1973. ; . - ' 

Abstracted by EDWARD J, DAVIS . ^ . .* 17 

' * f ^ - " 

Collis, Keven F. A Stud^ of Children's Ability to Work with.-- o 
Elemental Mathematical Sys't^ms. Australian j'oumal'^of , 
Psychblogy / v25 n2, ppl21-13b, August 1973. - . I • 

Abstracted by JAMES M. MOSER. : o-i 

■ Cromer, 'Fred Eugene. Structural Models for Predicting the Difficulty 
of Multiplication Problems. Journal. for Research in Hathemati'c s/ 
, \ Education ^ v5 n3, ppl55-166. May 1974. 

A6stract;ed by 'HAROU) L.* sfcHOEN 27 

Gubrud, Allan R. ; Novak, Joseph D. Learning Achievement and the 

Efficiency of Leanring the Concept of Vector Addition at Tl^e 
Piffei^ttt Grade Levels. Science Education . v57 n2, ppl7$-i9l^ ^ 
April/June 1^73. ^ , > 

Abstracted by H. LAVERNE THOMAS f . .'"T . 31 * 

Kosc, Ladislav. Developmental Dyscalculia.. Journal of Learning f 

Disabilities . v7 n3, ppl64-177, March 1974*! ^ • * 
Abstracted by NIC&OLAS A. BRANCA ; 

Kuhfittig; Peter K. F. Learning '^ds in the Aassroom: Experimental 
Evidence of TheiD Effectiveness. Educ^eion. v94 n2> ppl35-136. . 
November /Deceni>er 1973. 

Abstracted LARRY K. SOWDER 39 
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Lewis, D. G.; Ko> Peng-Si|r. Petsonality and 'Performanc/ in Element;ary 
Mathetmatics with Special Reference to Item. Type. British Journal 
6t Educational Rsychblogy . v43 ptl ,*pp2A-3A, February 19^73. 
/ Abstracted by^mRILY N. SUYDAM,. . . ' ' 43 

^achaels, Shirleyanne; fcleren,- R." An InvestigatioiT of Open-Book 

and Closed-Book E^Eamlnations in Mathematics. Alberta Jpuraafl 
. ^ tff Educational Research , vl9 n3, pp20?-2O7, September 19.73. 

Abstracted by LEWIS R. AIKEK. . . /. . . . a' : . ... . . 47 

Runnels,, Patricia; Runne^,- L. K. A Kindergarten Matheftatics 

Program. Schofer-stfence and Mathematics . v74 n5, pp361-365, / 
May- June ;974. - , ^ * " 
V • Abstracted by ROBERT E. REYS. .* \ 51 

Shufiiway, Richard J. Negative iRstances^^and the Acquisition of the 

Mathematical Concepts of Commutativity and Associativity.' .Final 

* Report. National' Center for Edu£ational Research dnd Develop- 
ment (bjlEW/OE) , Washington, D.C. ^June 1972 ' ^ 

SfiuDway, Jlichard J. Negative. Instances in^Mathematical ^Concept 

Acquisition: Transfer Effects Betwe^en the Concepts of. pommuta- 
tivity a|id Associativity. Journal for Research in Mathematics 
Education . v5 n4, ppl97-2l2 , 'November 1974. 

Abstracted by WILLIAM E. GEESLIN. . * * 

Soweli, Evelyn. Elementary Teachers Learn to Sequence Mathematics 

Instruction. School Science and Mathematics , v7A n5, ppAO 3-406^ 
May- June 1974. 

Abstracted by JAMES M. SHERRILL ."^ ... ^ 59 

Waits, Bert V.*; Elbrink,^ Larry C. Student Evaluation of Mathematics 
Instruction. Two-Year College Mathematics Journal / v4 n2, 
pp59-66^ Spring 1973. 

Sstracted by PHILLIP S. JONES ^ 6*3 



MATHEMATICS EDUCATIOK RESEARCH STUDfES REPORTED m RESEARCH' IN EDUCATION 
V , I ^anuary^- March 197A 



ED 081 17A Sraith, M. Daniel, Learning Difffculty^ Transfer., and 

Retentl^ as Functions of Two Types' and Two 'Levels of Redundancy 
in a Sequence of Concej)t Formation Dasks in Mathematics Involv- 
* ing Computer Assistance. Final -Report .* 135p. MF and HC 
' available from ED^. • ^ 

ED 081 470 Riley, Christine A.; Trabasso, Tom, Logical Structore ^ 
Versus Information Processing in. Making Inferences . 12p. 
"MF and HC available from EDRS. 

ED^081 511 Otaala, Barnabas, The Development of Operational Thinking' 
in Primary School Children'- An Examination of Sope Aspects 
6f Piaget's Th&ory Among the Iteso Children of Uganda . 117p. 
^ Not available from EDRS. Available from Teachers College 

Pres»> 1234 Amsterdam Avenue, New York, New York .IOC 2 7 ($3.95). 

ED Oai 620 Appel, Ida J., The Relationship Between the Sequence of 
Graph Interpretation Skills and the Sequence of Mathematics 
Skills for Kldd6r^arten Through Ninth Gradt t » 69Qp. Not 
available f ronr EDRS. Available from- University Microfilms 
, > ' (73-16,044) 

081 621 Tupesis, Janis Arvaldis, Mathematics Learning as a 
» Consequence of the Learner's Involvement In Interactive 
\ Problem-Solving Tasks' .' 182p.^ Not avail^abla from EDRS. 

'Available fro© University Microfilms (73-9293). ' 

ED 081 622 Diamond, Hannah, An Investigat^n of the Effi/:acy .of 
Piaget Cujrricular Element^ Integrated into a Traditional 
Head Start Program . ir8p. Not available froij EDRS. 
Available fro« University Microfilms (73-15,733).^ 

ED 081 623 Ball, Linda Virginia,^ Student Contracting for Achievement . 

Grades in Ninth Grade General Mathematics . 146p. Not avail- 
^able from EDRS. 'Available f-rom University Microfilms ^ 
(7j-16,70S. • 

ED 081 624 Walek, Bruce Peter, A Study of the Relationship Between , 
Conceptual Tempo and Problem-Solvihg Abilities of ^urth-^ • 
Grade Chl-ldren . 83p. Not available from EDRS. Available 

' * from University Microfilms (73-15,550). ♦ ^ 

ED 081 625 Ryoti, Don Eino," Student Responses to Equivalent Inference 
Schemes in Class and Conditional Logic . 98p. Not available 



from EDRS. ' Availafjle fram .University Microfilms (73-17, 395^). 
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ED 081 626 Albig, David L., A Study^ofthe Effects of Verbalization 
on Concept Formation in Mathematics . 200p. Not available 
from EDRS Available from Uiflversity Microfilms />3-18, 303) . 
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ED 081 627* Richer, Howard Marshall, Peer Teaching as a Facllltat'or 
of Learning: Using Conservation of Substance as a Measure . 
86p. Slot available from E DR S . . A vailable from Un|ver^ty 
V Microfilms (73-18,646). 

' ( 

ED 081 628 McUuc^lin, Jane AnA, The Relat ionsh'ip of Qpen-Ended vs* 

Closed-En^d Mathematics Laboratory Artivitles to the* DlvQry;ent 
Thinking Ability of Pre-Service Elementary Teachers . 198p. 
Not available from EDRS. Available from University Micro- 
films (73-19, 3«51). ^ y 

ED Q^l 62^ Howell Wayne, Moves and Strategies in a Skri.ll 

Venture in Secondary School Mathematics . 9^. Not avail- 
able from EDRS. Available f rom"lJhiversity Microfilms ' 
/ (73-17,449). ^ 

ED 081 630 Braxton, Loretta Murray,' The Effects of Instruction in 
Sentential Logic on thq Growth of the Logical Thinking 
Abilities of Junior High School Students . 137p. , Not avail- 
able from EDRS. Available frqin University Microfilms 
(73-18,994). . ^ 

ED^ 081 631 Carney, ^HaYold Francis, ' Tht? Relative Ef f ectivetiys of Two . 

MethOdsof Teaching the Addition and Subtract ion .of^Rationale 
Numbers . 146p. Not available from EDRS. Available frdm 
University Microfilms (73-19,411). 

p 081 632 , Taloumis, Thalia, The__Relationshlp of Area Conservation 'to 
. Area Measurement 'as Affected by Sequence of Pres^entjt ion of 
Piagetian Area Tasks to 3oys an4 Girls in Grades One Through 
Three . 220p. Not available from EDRS. Available frdm 
. Universicy Microfilms (73-19 ,-^50). 



ED 081 637 Shumway, Richard J., Human Concept* Formation ; Negabive 

Instances. Final Reportx 91^. MF and HC available ^rom EDR^. 

* ED 081 640 Scandura, Joseph M. , and others. Higher Order Characteri- 
zation of Heuristics for Compass and Straight Fdge Cpnst ructions 
in Geometry .v.^ Report No. 70. 85p. MF and HC available from « , 
EDRS^ 

• . ^ 

EO 081 8^ * Lindstrom, David R. ; Shipman, Virginia C. , Form Reproduc- 
tion; Technical Papbr 8.. Dl <^^;^Hv^T^faa^ d Children and Their 
FlrgJt School Experfences. ETS-Head Start longitudinal Study . 
Technical Repo'r-t Series . l!3p. MF and HC available from EDRS". 

ED 081 835 Mftififindr, Judith A., aft others. Spontaneous t^umerical ' 
Correspondence Test; Technical Report Disadvantaged ^ - 
Children and Their First School Experience. ETS-Head Start 
Longitudinal StTudy. Technical Report Series . 18p. MF 
) and HC available from EDRS. 
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ED 082 327 Meyer, *Jo Ann; Wurster, Stanley^., The Effect^of Threev 

^ Noise Levels on Task Attention and Perfoi^nce In Reading and > 
- Math>Wlth Fifth- and Sixth Grade Children ; 30p. MF and HC ' 
' available from EDRS/ . • . 

« • 

ED 082 510 Bjerstledt, Ake, Ed., Subject-Matter Oriented ilesearch; 

Sojae Current Projects at the Malmo School of Education . A2p. 
^ MF and HC available from EDRS. ] ' ^ ] 

ED^82 742 Greenberg, Barry;*T'uckf ield, Qloria, An Investigation of 
^ the Differences Between "Successful'^ and "Unsuccessful" Students 

it! trigonometry at Miami-Dade Community College, South Campus . 
4p. MF and HC available from EDRS* ' ' ' 

'ED 082 947 Broome^, Desmond Rodwell, Psychological and Sociological 
* ' Correlates of Mathematical Achievement and Abi'lity Airfong 

Grade 9 Students . 415p. Not available from EDRS. Available 
.from National Library qf Canada. * 

ED 083 0Q5 Leiderman, Gloria F. , A longitudinal Study of Mathematical 
' ' Achievement in the Primary School Vears; Description of 

■ Design, Sample^ and Factor Analyges of T^ts . ^ '157p"! MF'and 
HC available from EDRS. 

ED*083'Oj06 RtJsenthalrHill , Irene^ A Lo'ng'itudinal Study of Mathematical 
Achieveaent in the Primary»School Years: Curriculum and 
^ocio-Economlc Comparisons and Predictions from Previous 
Achievement . 442p. MF^and HC available from EDRS. 

EJ) 084 112 Romberg, Thomas A,; WJ.lson, Jamas W. , NLSMA Reports, No, 7 , 
The Development of Tests .' 391p.- Not available from EDRS. 
Available frohiA.'.C. Vroman, Inc. 

ED 084 113 Wilson, James W. , Ed., and others, NLSMA Reports, No. 8 . 
Statistical Procedures and^ Computer Programs . 221p. Not 
available from EDRS. Available from A. C. Vroman, Inc. 

ED 084 114 McLeod, Gordon ,K. ; Kilrfatrick, Jeremy, NLSMA Reports, ' 
No. 12_, Patterns of Mathedfetics Achlftvement in Grades 7 and 
8; Y-Population . 146p. Not available from EDRS. Available 
from A. C. Vroman, Inc. > ^ ^ 

ED 084 115 ^ (<Ulpatrick, Je^my; McLeod, Gordon K.T NllSMA Reports . 
, * No. 13, Patterns of Mathemati.cs Achievement in Grade 9; 

Y-Popuaation . ^0V« Not available froci EDRS, Available 
. » from A. C. v/omanl Inc. 

ED 084 116 McLeod, Gordon K. ; KXlpatrick, Jeremy, '^S^_Re20Tt8_, 
^ No. 14, Patterpg of Mathematics Achievement in Grade XO ; ^ 

Y-Population . 109p. Not available from EDRS. Available 
from A. C. Vroman, Inc. 
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117 Kilpatrlck, Jeremy ; McLeod, Gordon K. , NLSMA Reports, No, 
* 15 > Patterns of Mathematl^cs Achievement In Grad^ 11: Y~ 

Popul»itlon » 91p. Not available from EDRS. - Available from 

A. C. Vroman, Inc. , 

ED 084 118 ' Wilson, James W. , ^JLS^^A Reports, 'No. ^^16, Patterns of Mathe- 
matics' Achievement in Grade 10: Z--P>opulatlon » 115p. Not 
available from EDRS. Available from A. C. Vromaa, Inc. 

ED 084 11^ Wilson, James W. , NLSMA Reports, No. 17, Patterns of Mathe- 
matlcs Achlevem^ent In Grade 11: Z-Populatlon . 140p.' Not 
^aval^able from EDRS. Available from A. C. Vra^a^ Inc. 



ED 084 120 Romberg, Thomas A.; Wilson, James W., NLSMA Reports , No. 
18. Patterns of Mathematics Achievement In Grade 12; Z- 
Populatlon. * 78p. Kot available from EDRS. ^vailable from 
' A. C*^ Vroman, Inc. ^ 

ED 084 121 * Travprs, KetyiethS^^ NLSMA Reports , No. 19, Non-Intellectlve, 
^ CdrrelatLes^ of Under- and^verachlevement In Grades 4 and 6. 
330p. Not Available from eDhS^ Available from A. C. Vroman, Inc. 




ED,084 122 Crosswhite, F. Joe.' NLSMA Reports^ No. 20, Correlates of s 
Attitudes Toward Mathematics , lllp, i^b<^^avail^b le from EDRS. 
Available from A. C. Vroman, Inc. ^ 

ED/084 123 Wilson, James. W. , Ed,; Begle, Edward G. , Ed^^" "NL$MA Reports , 
No. 21, Parts A. B, and C. ' Correlates of Mathematics ^1 eve- 
* pent: Attitude and Role Variables . l,453p. Not>^llable 
from EDRS. Available from A. C. Vroman,' Inc. 

' ' ,> * 

ED 084 J24 Wilson, James W. ,* Ed.; Begiy, Edward' G. , .E<^. , NLSMA Reports. 
No. 22. Parts A, B^, and C, CortfrTates of Mathematics Achieve- 
. nlent;> Cognitive Variables^ ^:485p.' .Not available from 
'EDR§. Available ^frotn A. C.^ Vroman, Incr • 

ED 084 125 Wllgon, James W. , Bd^; B^gle, , Edwarti G. ^Ed. , NLSMA Report^, 
No. 23, Parts A. B, and C, Co rrelatgs of Mathematics Achieve— 
^ ment: Teacher Background and 'Opinion Variables . l,69<)p. Not 
available from EDRS. Available from A. C. Vroman, Inc. 

^ ED 084 126 Wilson, James W. , Ed.; Begle, Edward G. , Ed., NL'sMA ^Reports . 

No. 24, Parts A. B, C, and D. Correlates of Mathematics Achieve- 
ment: School-Conmupity and Demographic Variables . l,883p. Not 
available' from EDRS. AvallaJ)le from f^. C* Vroman,* Inc. 

ED 084 127 . Wilson, James^ W. , Ed.; Begle, Edward G. , Ed., NLSMAjReports . 
No. 25, Parts A. B, and C, Correlates of Mathematics AcMeve- 
meiTt; Teacher Assigned Grades . l,367p. Not available from 
EDRS. Available from A. C. Vrottian, Inc. , 
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ED 084 128 Wilson, James W. , Ed.; Begle, Edward G. , Ed., NLS^ Reports . 

.No. 26, Correlates of Mathematics Achievement! Summary ; 213p. 
Not available from EDRS. Available from A. C. Vroman, Inc. 

ED 084^129 Begle, Edward G. , NLSMA Reports, No. 27, The Prediction of 
Mathemati cs Achievement .^ 144p. Not available from EDRS. 
Available from A. C. .Vroman, Inc. 

ED 084 130 Begle, Edward G. Geeslin, .W^liam Edward, NLSMA Reports . 

No. 28, T eacher Effectiveness in Mathematics Instruction . 146p. ' 

Not available ffom EDRS. Available from A. C. Vroman, Inc. 

t • ^ 

ED^084 131 Branca, Nicholas A., NLSMA Reports, No. -30, Follow-up 

Study of 4JL&MA Z-Population . 14 3p. Not available* from EDRS." 

Avaiilable from A. Q. Vroman, Inc. 

ED 084 132 . Dodson, Joseph W., NLSMA Reports, No. 31, Characteristics 
of Successful Insightful Problem Solvers ^ IJ^p. Not avail- 
able from EURS. Available from A. C. Vroman/ Inc. 

f 

ED 084 133 Bridgham, Robert G. , NLS!^ Reports., No. 32, The Effects of 
Differe nt Mathematics Curricula on Scifflce Achievement in the 
Secondary School . 13p^ Not aval lab le"lE7??m EDRS. Available 
from A. C. Vromafi, Inc. 

ED 084 134 Wilson, Janes W. , g^d. ; B^gle, Edward G. , Ed. ,' NLSMA Reports . 
^fo. -33, Intercorrelations of 'Mathematical and Psychological 
Variables . iq6p. Not available ^rom EDRS. Available from /\ 
A. Q. Vroman „ Inc. " « \ 

ED 084 139 Phillips, John Durwood, the Jlelationship^ Between Selected 
Piagetian Tasks and Knowledge of the botitWt Areas in Fifth- 
Grade Children . 96p. Not a^^ailable froto EDRS.^ Available • 
, from University Microfilms (73-14,288). ' 

i 

ED 084 154 Geeslin, William Edward, An Exploratory Analysis of Content 
Structure and Cognitive Structure in the Context of a' Mathe- 
matics in structional Unit> 213p. MF and HC ^tvaUable from 
EDRS. ^ • . * 

ED 084 156 Townsend,* Jleal R. ; Wheat ley, Grayson H; , Frequency of ' 

^ Te^ts ^nd Feedback of Tas.t Results in Calculus Classes . lOp. 

MF and HC available from EDRS. ^ ^ ^ ^ 

• « 

ED Q84 l58 Searle, Barbara \if, and others, Structural'Variables 
Affecting CAI Performance on Arithmetic Word Problems of 
Disadvantaged and Deaf Students . 32p. MF and HC available 
^ from EDRS. ' - . , 
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MATHEftATICS EDUCATION RksEARCH STUD-IES REPORTED IN JOURNALS' AS INDEXED BY 
* , . CURRENTv iJiDEX TO JOURNALS IN EDUCATIO^T . ' 

% January - March 1974 

\ ^ • • 

. ^ * ' / ' ^ * 

EJ*083 215 Yeshunin, Shw/ga. "A Reinforcement Study on Servitie Courses 
in Mathematics and Statistics, " International Journal of 
Mathematii cal Education in Scierice and T echnology, 
PP127-132, Apr-Jun 73. ^ ^ — ^ 

y 083f 85A fiichaels, Shirleyanne; Kleren, T. R. "An Investigatidn 
of Open-Book and Closed-Boolj Examinations in Mathemati-cs. " 
Al'berta Journal of Educational Research , vl9 n3, pp202-207/ 
, Sep 73. • ' ■ 

EJ 083 a56 Cathcart , W.^ George; l|iedtke, Wernei? W. "Role of Con- ' 
ceptual Tempo in Concept^ormation Alberta Journal of " 
Educationa l Research . vl9 n3,. pn2i:^223, Sep 73. 

.e3 085 112 Si:^'dura, Joseph M. "Deterministic Theorizing in 'st?ruc- 
, ' tuual Learning: Thcee Levels of Empiricism." Journal of 

* ' Structura l Learning. v3 nl, pp21-53, 71. \ ^^"^ 

EJ 085 117 Williams, John D. "^^odern VlaWematics , Intelligence and 
Basic Conceptual Skills. " .. Journal of Structural Learning. * 
v3 n2, pp79S»88, 72. - ~ ' ' ^ 

EJ 085 120 Williams, John D*.'; Fog^lman, Kenneth- R. "Sets, Logic Wd 
Intelligence Tests," . .'jovlrnal of Structural Learni ng. v3 n3, 
pp25r36, 72. . — \ * 

^ 085 121 Connes^ Bernard. "The Use of Elect roni<; Desk Computers in 
Psychological E^x^in^ents . " ^ Journal of Structural Lea rning. 
v3 n3, PP51-72, 72. ' ' ' ^ \ ^ ~ 

tS 085 123 Scandura, Joseph M. ; McGee, Robert. "An EjcplOratory 

Investigation of Basii Mathematical Abilities of Kindergarten 
Children." Journal o f Structural Learning . v3 n3; pp 79-98, 72." 

EJ 0.85 124/ Bart, William M.; Wiener^ Wil^a K. "Transformational 
Closure »for the Concept Clock." Journal of Structural 
J Learning . v3 n3, pp99-107, 72. 

EJ 085 125 Mueller, Edward; And Others.' "inherent Perceptual Motiva- 
tion and the Discovery of Structure." Journal of Structural 
LeAming . v3 n4, ppl-6, 72. . ^ 

EJ^O'85^ 1?.9 Williams, John D. "The Evaluation of Three Maths Courses." 
1.^ " * Journal of Structural Learnin<^ . v3 n4, pp41-79, 72. ' . ' 
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^EJ 085 137 Conioliy, Austin J. "Research In Mathematics Education arid 
the Mervtally Retarded." Arithmetic Teacher . v20 n6, .pp491-A97, 
Oct 73.* " " / ^ . ' 

/ ... ^ ^ 

EJ 085 Morman, SheH)a Jean. "An Audio-Tutbrlal Method of.Instruc- * 

tion vs the Traditional Lecture-DiscussJ-on Method." Two-1fear ^ * 
College Mathematics Journal , v4 n3, pp56-61, F 73. . ' - ' 
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/ EJ 093;5;i , . , SE 510 7U 

THE INFLUENC^E OF PROFE§SXONAri^£FEXENgE GROUPS ON PECI^ONS OF PRESERVICE 
SECONDARY SCHOOL MATHimTlCd TEACHERS. , Bright, George W, ; Carry, I^. Ray, 
Jougnal for Research ig Mathematics Education^ v5 n2, pp87-97^ Mar 74. ' 
'Descriptors— *pecision Making, *Pj:eservice Education,^ *Rese^arch, 
*Secondary School Mathematics, *Teacher Education, Ediicational 
Theorie:^, Mathematics tducdtion^ Models 
« 

, Expanded Abstract dni Analysis Prepared Especially fot I.M.E. by Thomas 
,J. Cooney, 'University of Georgia*-* 

^1. Purpos^ 

The 'experimenters investigated the following two hypotheses: ^ 

a. . The profeisionalrr^ference'gJoup of mathematicians and the 
^, corresponding ^roup of educators ^^fluen-cie the decisions 

i of preserVice secondary school mathematics teachers in. • 

" projected classrpom situations. " " ^ ' 

b. .The influence of mathematicians .as^^a reference group is 

s£rong«r t'han the influen^'^^f edu6^tOrs orf the decisions ^ 
of ,preservice secondary school mathemati^is teachers in - ' 
projected classroom situations. • i 

2. * Ratlon^6 . . , ^ * . y 

«The theoretical basis for the study consisCed of Heider's and 
- Kretch's work involving ^hat is called balance theory . 'Hcider described 
the cognitive structure of an individual P in terms of two kinds <)f 
relations,^ The fjrrst reflects ^n individual's feelings about an objfect 
or personjT. The second \invo Ives an' individual's perceptions of the 
^relatioQ between two objects or other persons. \ ^ 

^'•Kretch, et al. interpret Heider's- theory in, terms of a triadic - 
reiatrfonsh^ip which could be represented by a triangular configuration. 
One vertex could be characterized as a Subject P', another as an obje,ct 
0 towflr4 vh^Lch P has a certain attitude, and the thir<f, vertex as a 
person ^(s) X toward w.bidi P also had a certain attitude. .The ^egment 
between 0 and X represents an attitude, perceived by P of X toward 0. 

',In the present study the triadic relations'h^ip involved the subjects, 
pres^rvlce secondary mathematics teachers, and two professional groups - 
•mathematicians and educators t \^ich might be represented hy P, 0, and X 
respectively, the experiip^nters made two assumptions. (1) -subjects 'had 
a positive attitude tijward mathematicians (P toward 0) ^and (2) the* 
subjects perceived a negative relationship between mathematicians aoti 
educators C©^nd X). A triad is .balanced if /&\e product of the Bigns oi , 
the three relatiopahips is positive.. Given ythelr two ^sumpti6ns this* * 
led the experimenters to conjecture a negative relationship between 
subjects and educators. Hypothesis (6) theA follows. 
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Research Design and Procedure 

Preservice secondary school ^theoatics teachers were randomly 
assigned to an. experimental group (N * 28) and a control group (N ■ 33) 
from two method^ closes (no practice - teaching experience) and one 
student - teaching seminar, (engaged in practice - teaching). Thirty-six 
hypothetical classroom problem situations were depicted albng with three 
equally a^^cep table resolutions (as best determined by the experimetil;.ers • 
through a pilot study), to the problems. The problem situations were 
equally divided into four categories, involving preparing and teaching» 
classes, organizing classes, evali^atiijg qourses, texts and^ teachers , 
and educational philosophy and policy. ^ • 

Booklets « containing each problem situation followed by the three* 
resolutions randomly ordered were districted to subjects. For the 
experimental group the terms ^'mathematicians'^ ind "educators" were 
r and omJLy' assigned to resolutions in 24 of the 36 problem sitifatiops. The 
remaining 12 were used* to hel"^ the instrument appear more r^ali^ic by 
placing both the labels "mathematicians'* and "educators" adjacent to the 
same resolution. The subject^ were told that the labels indicated which 
of the three resolutions *w*ere judged 'most acceptable by the two profes- 
Clonal groups. The control group reacted to the safte problem situations 
with the same resolutions. However, in the contx^l group the subjects 
'^were not given labels attached to' the resolutiotis . After subjects in 
the control group made their selections, labels were then randomly 
assigned^ to the resolutions. Hence 'it was eJcpected that a subject in 
the control group would select 8 resolutions labeled "mathematicians," 
8 labeled "educators" aod 8 without labels. 



4. Findings ' * " . * \ 

The mean number of responses in the expei^imental ^roup j^as 10. J. for 
the ^mathematician- labeled resolutions, 10.5 for the educator-labeled 
resolutions jrtd 3.4 for the remaining non- labeled 'items. The correspond- 
ing statl^stics for the* control group-were 8.5 (mathematicians), 7.9 
(educators), and 7.6 (no labels).. 

To test' Hypothesis 1, the Kolp^lgorov-Smlmov test was. applied 
using a cumulative frequency distributioa. Th'e test yielded significant 
statistics which supported Hypothesis 1 (p .03 for mathematicians, 
p .01 for educators)*. To test Hypothesis 2, the Wilcoxon matched pairs, 
sigfted-rank test was applied to the responses of the .experimental sub- 
jects. The computerTTvalue (-.28) was not significant at the .05 \evel. 

A post hpc arralysis tevealed that the two types of subjects in the^ 
experimental gto^ip (methods -course only vs. methods course and student- 
teaching seminar^ seemed to h^e reversed their agreement pattern^ That 
is, the methods otily group favored .responses idenjj^ed with mathemati- 
cians (10.5) over those identified with the educators (9,6). The methods 
and seminar subjects favored the responses aligned v^ith educators (11.5) 
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over the responSies aligned with* the ma'theoaticians (9.7)." An application 
•of the Kolnolgor^v-Smirnov t§st yielded *no significant differences. 



5*.' Interpretations . \ . « 

t The attacjiing^of labels did influence tHe responses of the aubjects. 

Howetrer, there wer&^no differential effects of the labels as hypothesized. 
AUhough the post hoc analysis di4 not yield a significant statistic, Jthe 
experimenters felt it would be of interest to investigate further the 
differences between the two types of subjects. ^ 

^ ' The expeVioeaCers noted several limitations if the study. » 

. a. The sample may have been "atypical of the entire population 
of all prospective secondary school laathematics teachers.." 

b. The observed behavior of the subj'ects were not classroom 

behaviors'. Hence there may be* a dif f erfence in the alternative 
a subject might select i,n written form and how the subject 
. might actually behave in th^ classroom. 

.c. Failure to detect 'a difference .between "the effects of the 

two r^etehce groups may be'due to inconsistent interpretation * 
of the words 'educators* and 'mathematiciaa.* - these were not 
defined." 

The experimenters conjectured that when teachers attend IJCIM meetings 
* that "the group that a speaker represents nay be as Important in determln- , 
ing the impact of the speech as the content of^ the sjTeech." The authors ' ' 
also state that it seems evident that the teaching of*content and methods 
should be closely coordinated for preservlce secondary mat)iematics 
teachers. The experimenters feel it is desirable -that prospective 
•teachers not perceive, a "polarization of opinion between content-oriented 
professionals ^ education-oriented professionals.*^ ' 

The experimenters suggested a similar investigation be conducted 
using inservice secondary school mathematics teachers as subjects. 

Abstractor's Notes ^ * 

This was an intMeatingr study. The e3q;)erimenter8 do an excellent 
job in identifying potentially serious Umiting factors of the inveati- 
gation. Their identification of the second factor identified above f« 
particularly appropriate. Statements of intended classroom beKavicJr by 
preservlce teachers is^ot always a^ reliable Indicator of haw they will 
actually behave in-liveVlassroom situations. , ThdCs is not I criti'cism 
of the study but rather, to accentuate what the experitaentets have 
stated - that we haven't found out anytjjing about how teachers would 
behave in the ciaasroota. Although the problem woiHd be considerably 
snore complex^ it would be interesting to investigate how the reference 
groups referred to in this study might influence teaching behavior. The 
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third limltatiotv cite4 above is a prime candidate for* a confounding ' 
factor. Ho^ woulS ^subjects likely classify a mathematics educator? 

> • < 

^othe^ concern is the extent to which one can assured that the 
reference groups "mathematicians" and "educators" were the influencing^ 
factfo^' as opposed to, other possible reference groiips. That is, would 
the rest\lt8 have be»n basically the same had different reference ^oups 
been ^elected - perhaps only remotely related to mfithem^tics education? 
If furtly»r research indicated that reference groups lin general influence 

^decisions then conjectures different ftpm those gi^ven by the experimenters 
should b^ formulated. ^Given*the results that were obtained, the con- 
jectures, that the impoft of a speech'may be determined as, much by the - 
reference group of the speaker than b^ the actual content of the speech 
and that the teaching of content and methods should be closely coordinated 
seem unjustified in terms of the specific findings of the study. < 

^ In generating their hypotheses, the experimenters made, two assump^ 
tions identified earlier in this abstract... The a^umptions themselves 
^ might be ex^ined. * They certainly raise'/resTearchable questions. Finally, 
can the findings be related, in any way to the theory set forth iiv the 
beginning of the Article? Implications stemming from the study in terms 
of Ueider*s and Kretch*s work were not discussed. 



. 4 Thomas J. Cooney ^ 

* » University of Georgia - 



V 




u\:., 



ERIC 



16 



EJ 086 751 ^ ' ' ' ' SE 509 5^ 

TASK-ANALVSIS PROCEDURES IN MATHEMATICS INSTRUCTION OF ACHIEVERS AND 
UNDERACHIEVERS. Callahan, Leroy G. ; Robinson, M^ L. , School Scienc e 

and Mathematics , v73 n7, pp578-584, Oct 73. 

Descriptors— *Educatlonal Research, *Elementary School Mathematics, 
. *Instructlon, *Teachlng Methois, *Teachlng Procedures, Educational 
Diagnosis, High Achievers, Low Achievers, Mathematics ^ucatlon, * 
(Research Reports*) ' ^ . ~ 

Expanxled Abl^ract and Analysis Prepared Especially for I.M.E/ by Mary Ann 
Byrne, University of Georgia. 



1^ Porpos e 

; 

To examine the ef fectlv%iess of task-analysis procedures for sixth 
^grade m^der^chlevers . The iiathematlcs task was "to decide the value of 
the two places to the right of the ones place in base ten numerals and to* 
write the value of these places in expanded notation." 

2. ^ Rationale 

Poor instruction ("failure to provide for individual differences^ 
stress on speed, . . Tand faulty assumptions . about the transfer of train- 
ing . .) and a, child's Inadequate basic skills are pedagogical factors 
that, contribute to underachievement. A method of last met ion, based on 
Gagne's theory of learning hierarchies should be especially appropriate 
for underachieving students. This method would consist in analyzing a 
learning task bacTc^ to basic skills,' diagnosing the subordinate tasks 
that a student is weak in, and providing instruction until a, student has 
mastered 6ach subordinate task. 



3. Research Desip and Procedure ^ ■ . 

The design for the study (not explicitly s.tated) seemed to fte a post- 
test control ^royp design. Ail sixth grade students at a middle class 
school were given a question' testing the fttainmeat of the task: Expanded 
notation ^.n tenths and hundredths place. Students who answered correptly 
were excluded as potential subjects. The postteat also' consisted of a 
question tcstiiig the task. 

A 2 x 2 classification of four "groups was established using the 
factors of control-experimental and achievers-janderachlevtfrs . There was - 
a random assignment of atudents^ into either a control or. experlxoentai 
group. The treatment pri/vlded to the subjects in the experimental ^roup 
was individual' instruction ^lyen by 'the researcher. Ihls instruction 
included concrete and pictorial material, and was directed toward tbe 
subordinate learning tasks which ]tj^e student had answered tncorrectl!^ on 
an initial test over the si^rdinati^ .tasks . The control group received 
no instruction.' < ' ^ 
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Students were classified as achievers 6r underachlever5 using the 
difference -between an IQ standard score and a mathematics achievement » 
standard score. The standard scores were based on the sixtb grade 
population^ of the school. An underachlever was defined as a student 
with a mathematics a^levenent score 0.50 lover than the IQ standard 
score. Other subjects were defined as achievers* 

From each of the lour groups described, 6 subjects were randomly 
selected for the studjf. These 24 subjects were tested over the sub- ^ 
ordinate tasks, not the final task. The experimental subjects received 
^appropriate instruction until mastery of e^ch subordinate taak was 
attained. , . * 

i^Data was compiled concerning- Xhe nunijer of subjects in each group 
who answered the po^tte^st correctly, thfe subordinate taslp missed o^ the 
initial test and the instructional time taken by "the experimental sub- 
jects; -^d IQ scores for each group. ^ ^ / 

: ^ ^, . ^ 

4. Findings . ^ • 

• ^ 

None of the control subjects answered the posttest correctly. In 
the experimental group, four of the six under^chlcvers and five of the 
six achievers completed the task- correctly. 

• V 

On the test over subordinate tasks, the achievers and underAchlevers 
.demonstrated siodlar patterns of cortect responses. Considering the 
final task a& Level I,,yihere were six levels in the task anaJfysi^. 

Xhe median, Inst nitt ion time for the underachlevers was 57.5 minutes; 
for 'the achievers it^as 37. 5 , minutes. 

The mean IQ score for the achievers was 101.5; for tlie undei?^ 
achievers it was 116."A.* The highest IQ score for the achievers* group 
.'was 109, the lowest for th^ underachieving group was 107.' 



5. Interpretations . ^ * \ 

The method of "diagnosis and instruction based on a hierarchical 
analysisi of subordinate tasks is a^ effective procqduj^e for s^dentA* 
learning of a mathematical task." 

•*\ 

Underachlevers require more time to masffer subordinate tasks thfcn 
achievers. 



Abstractor's Notes 

The study as reported Identified an educational problem, th©^ 
instruction of underachlevers, and a method of instruction, task analysis. 
It was ^proposed that? the particular ttfethod would be effective in alllevi- 
atlng the problem. But a specific questiorf was not cleady proposed for 
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tjic study itself. ♦ So it is hard to interpret the results and to accept 
the conduaions reported; . » ^ / 

r. 

The instruction on subordinate task^ did make a difference to 
achievement on the mathematics task", the experimental group did better 
than the control. " * * 

It i,8 hard to justify any other conclusion using the posttest »data. 
Thjire was no hypothesis describing wh«t kind o£ behavior on the posttest 
was expected as evidence of "decreasing underacKifivement. " The under- ^ 
achievers were. 'probably achieving, or learning from instruction in their 
re^ar class, but they^were not achieving at the level of their 
ca^ility. Frpm the data reported it is not clear how the researchers 
could conclude that the "underachieveoent was decreased" when under- 
a<fhievers had a mean IQ score 15 points' above tKe ac^iiever's mean IQ 
^ score and yet ha4 4 out of 6 subjects respond correctly to ^he posttest 
while 'the achievers h^d 5 of 6 subjects to respond correctly. *The 
researchers may have some data supporting their conclusion but it was 
not reported adequately. 

I Th,e researchers referrted to several studies reporting the use^of 
task analyeis for mathematics tasks. 'The present study 'as reported 
seems to be qnly a replication without specific implication for under- 
achievers. * % * 

' ^ ' 

A final comment ' A test of one item i^ seldom adequate to maasure 
reliably a subject's ability to p^form a task. . It is possible that the 
particular numbers used or the way of asking a question may influence a 
gtudent*s response. .Several questions on the given task would be ♦ 
appropriate. ^ ^ 

Mary Ani\ %yme * * . •* 

U^versity of Georgia 
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ROLE OF JCONCEPTUAL TEMPO IN CO^CEPI^ FORMATION. Cathcart, .W. George; 
*Liedtke, Werner W. , Alberta Journal of Educational Research . vl9 n3,^ 
pp2l6-223, Sep 73. ^ ' , 

Descriptors— *Concept Formation, *Student Reaction, *Research 
Design, *Mathematics, Academic Performance; Elementary -School . 
Students, Achievement Tests, Tables (Data), Analysis Of ; \. 
Covari^ce, (*Matching Familiar Figures) 

Expanded Abstract and Analysi^Prepared Especially for I.M.E. by Edward 
J. Davis, University of Georgia. 

X* Purpose ^ * 

This study was. designed to investigate relationships} between the 
conceptual tempo -of. 7 1/2-8 year old children and the performance of these 
children on conservation of Ipngtlv tasks, an intelligence test, and onf 
test of mathematics achievement. Conceptual tempo' lefers to the rate/4ncf 
accuracy of responses chil<^en make when confronted with tasks lor*'^ch 
they ku3t cho6se among £ number of responses. Some children tend t^ 
respond quickly and incorrectly, others tend to deliberate and be more 
accurate. Hence the labels impulsive and reflexive- are used to describe, 
the 'conceptual tempo of children. 



2. . ^Rationale ^ ^ ^ , 

* - ' 

Aspects of the relationship of conceptual tempo to intelligence, 
' heading skills, mathematics achievement, and conservation of length ijave 
^been investigated by other authors. Kagaa .(1963> found differences in 
conceptual tempo among children of equal intelligence and that ref^lective 
children Appear to hav^ an advantage in reading skills of word recognition 
and word recall. ' CTathcart and Liedtke' (1969) "tfilported results indicating 
reflective children achieve best in mathematics. Callahan and Passi 
(1971) report a non-signif icanf tendency fox reflectfive children in 
grades K'-l to be better able to conServe length. * , 

This study was designed to examine relationships^^between cdhceptual 
tempo, intelligence, mathematics achievement,* and conservation of length*, 
in a more careful and. rigorous way by considerin'g sex, mat-hematics 
achievement in terms of understanding concepts, recall of basic facts, 
and problem solving, and by using intelligence as a covariate. . ♦ 
• * ! 

3. Research Design and Procedure ' * 

After selecting 59 second grade students the authors administered 
2 practice and 6 test items from Kagan*s "Matching Familiar Figures" 
(MFF) test designed to iclentify subjects as impulsive or revflective. ^ 
Subjects scbring below the median time to complete the ttfst seconds) 
and above the. ^.edian number of errors (KA) were classified as impulsive. 

" - 17 ^ ' 
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. Subjects taking longer than 14 seconds to complete the test and, making 
fewer than 1.4 errors were classified reflective, ikis scheme classified 
> 20 subjects as reflective and 22 as impulsive. 

The authors designed a conservation of length test of ten^ items, 
^ach faced the chiLd wit^ arrangemefits* of eithef sticks ancV string*, 
toothpicks, or strips of paper. A procendure of presenting two objects 
or arrangements with coterminoi^s endpoints, establishing a length 
relation, and trdhsforming the physical arrangement was employed. 

• • i 
^ f 

A 31-item mathematics achievement test yielded subsco/es on know- 
ledge ot concepts (from 15 Multiple choice i tems) , recall of basic 
facts (10 itefos), and^problem solving (from 6 verbal problems). These* 
items were taken from the mathematics text used in the children's mathe- 
matics program. . 

* * * 

Intelligence scores were obtained from the Otis Quick-Scoring 
Mental Abilities Test (alpha). This test yields a verbal and uon-verbal 
^ sub^cpres and a total score. . ^ ^ * 



4. Findings • . ' * / 

Girls tended to be mor^ ref lecti,ve~^d boys more in^uldive. Of the 
20 reflective subjects," 8 were boys and 12 were girl^. Of the 22 
impulsive childi^n, 16 were male and 6 were /emale. The resulting Chi 
Square fov this distribution, was significant , at the .032 level. This 
was the only sex related ^indin^ (niaiii effect or interaction) in the 

' stlidy that approached or exceeded sr^ificance at the .05 level. , In 
rel£^tian t6 intelligence scores,, refl-exive children were significantly 
higher (^014 level) on the 'non-verbal subscorfe and oi^ tKe total score 
(»036 levfel). However, no significant interaction was found tetveen 

'Conceptual tempo, sex, and any of the three IQ measures* ' • 

To examine the relationship between sex, IQ, concept u^I^ tempo, and 
^ the thxee components of mkathematics achievement a two*Way analysis^ of 
covariani:e ^was used with IQ as tnk covariate and sex as a blodcing 
variable' \ ' , ^ . 

* t . 
The following table presents the results(of the two-vay analysis' 
of cqvariance. ' 

, TABLE 1 

ANALYSIS OF COVARIANCE BETWEEil GROUPS QN MATHEMATICS 
ACHIEVEMENT (COVARIAHS - IQ) 







Mathematics Achievement Test 




Group^ 


Concept 


Problem Solving . 


Basic Facts 


' Total 


Reflective 
Impulsive 

^(1>23) 
Probability 


7.32* 
7.75* 

— :28 

.39 


.1.46* 
1.03* 
.65^— ' " 
.43 


•7.9^* 
6.06* 
f 6.20' 
.^2 


16.75* 
14.83* 
1.70 
.20' 


*Ad Justed, means* 
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The interaction between sex and conceptual ten^o was npt significant 
'for the criterion measures in this analysis of covariance. The table ^ 
shows hi^er adjusted means •for reflective subjects on problem solving 
and basic facts. Only the latter was considered .significant . On concepts 
the adjusted mean for impuj.sive children was slightly higher. This 
difference was not significant. ^ • ^ 

An analysis of covariance was also used to investigate the relation- 
ship of conservation of length to conceptual tempo and sex. It was 
hypothesized a relationship^xists between conceptual tempo and conserva- 
tion. The table below presents the results of this analysis. Intell;^genc< 
Was ag^n the covariate/ The table does not show the adjusted means on 
the lO-iten conservation test for refleotive ^d impulsive children. Thes 
were 7.61' and 5.51 respectively. This difference was significant at the 
.04 level. . \ . . 

^ . TABLE 2 . 

. ANALYSIS OF COVARIANCE BETWEEN GROUPS ON gONSKRVATION 

<^ OF LENGTH (COVARIATE - IQ) ' * 



Source , ^ 


SS 


DF 


MS 


• 

F 




Conce^^ual Tempo 


29.99 


1 


29^.^99 


'4.46 


.04 


Sex 


9.95 




9.95 


1.48 


.23 


Tempo X Sex • ^ 


' 0.02 • 




0.02 


- 0.003 


.09 


Within • 
• 


154.59 


-23 


6.72 






Total 


194.55 











5. Interpretations 

In relation to'' the findings concerning the three comgOtoents , of 
mathematics achievement the authors conjecture the. superior performance ' 
of reflective children in recall of Ijasic facts could be attributed to 
their taking the time to "figure out" answers using aids such as fingers 
or an avtfiiable number line. Some childien employed such procedure's, 
others responded inmediatjely or not at all. H6weyer, no record of which 
children used these differing strategies was obtained. The suggestion la 
made that this issue be studied further. No conjectures ar^ offered for 
the results "indicating npn-dif f erential performance of reflective and 
impulsive children or concepts and problem solving. 

The significant difference in the adjusted mcAns of reflective and 
impulsive children on the conservation test is interpreted as evidence 
that reflective children conserve length before impulsive children. The 
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344ggestion is made tha^t observation of other properties al'so be studied, 
with respect to conceptual tempo. Similar findings would result in* 
import^t implications for many teachers. > - 

The authors make an observation with respect to intelligence 
measutes: ' * • * 

If reflective children score higher on intelligence tests 
than impulMve pupils because they take mo^ time to wfeigh 
alternatives befor^ tHey respond then thwre exists another 
, reason for questioning the validity of arf intelligence test'^ ^ 
The question '*what does it measure?" seems^to have ^dded tppan- 
ing when considered in the light of the results reported here. 

* r ' * 

The fidlure of sex to be significantly related to any of the other . 
variables was considered evidence that sex related differences in con- 
ceptual tempo were maturational. The observation was also made that 
children slov to answer a te,acher*s questions may differ fixim their more 
quickly responding classmates in conceptual tempo and not ^n intelligence. 
Many teachers may tend to o^>erlook this possibility. , 

^ ^. * 

' Abstractor's No tes' ' - 

' T 

^il« the title of tltfe article ia sbmewhat misleading, the authors 
should be commended for de^gnirt^this interesting study, for using 
intelligence as a covarlate, and for considering mathematics achievement 
to be multi -dimensional. However, the apparent lack o,f a relationship 
between conceptual t«mpo, probleja solving, and knowledge of concepts was 
undoubtedly a surprise. Perhaps £he problems were too siniilar to those 
the children had practiced it^ class or the concepts tested were',too 
familiar to ♦result' in differential performance. ; . . 

The failure to We able to classify the number of'chJLldren taking 
time to figure out basic facts and those responding immediately as either 
reflective or impulsive is disappointing. This shou-ld be resolved; 
however it should be noted that the recalljpf basic facts used here is 
not a measure of memorized responses. No^Svidence on the relatlj6nahip of 
conceptual tempo Lo memory has befen gathered if subjects are allowed 
time to work out responses .'^ * 

It should be emphasized the initial classification of children as 
•reflective or impulsive was based On both time and accura^cy of responses 
to itcmo. on Kagans (MFF) test. Hence, those children cldssified as 
reflective had demonstrated some intellectual superiority over those 
classified as impulsive. This appears to be standard practice in 
defining conceptual tempo and appears to tKis reviewer t6 make conceptual 
tempo of lltalted value in investigating developmental phenomena. There 
is another concejm about the Authors questionfag the validity of an 
Intelligence test. Theix comment, quoted abovST somewhat masks the fact 
that childiren they classified as reflective were not accurate in respondr 
ing to the MFF test as well as more deliberate. This also makes the 
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failure of Reflective chilffsen fco significantly out perform impulsive 
children in problem solving and concept^ recognition even more surprising. 

The evidence indicating r-eflective children conserve length before 
impulsive children, coupled with the tendency by Callahan and Passi's 
subjects to do the same, is worthy of note. Somewhat puzzling, however, 
is the author's Claim that similar findings .for conservation of other 
properties would have important instructional implications. Just* what 
are the implicattpna? Should children be trained to be more deliberate^ 
or should different instructional strategies be employed for reflective 
and^ impulsive children? 



Edward J. Davis 
University of Georgia 
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cv™*^^ CHILDREN'S ABILITY TO WORK WITH ELEMENTARY MATHEMATICAL 
' pJl2So,^Jg^^73^^''^ Australian Jou rnal of Psvchnln^ . v25 n2, ^ 

Descriptor8~-*MatKematical Concepts , .^Learning Processes; ^Cognitive 
'Processes, *Student Research, ^Cognitive Ability, Instructi-onal 
Materials, Elementary Education 

Expanded Abstract and Analysis Prepared Especially *for I.M.E. by' James ,M. 
Moser, University of Wisconsin. 

1. Purpose , * ^4 

The purpose of the study was to gatheV data relative to the ge^neral 
questi9n of how well children of differing age levels can perform on a 
task requiring formalToperational reasoning. 

2. Rationale ^ ^ 

. Previous studied using mathematical material and the Piagetian model 
of cognitive development seemed to imply that subjects ar6 not able t<^ 
work within a closed abstract system before they have attained the 
capacity for formal-operational thinking. In recent years, the mathe- 
matics teaching in Australian (and American) schools seems to have shifted 
from an emphasis on the development of the computational skills to the- 
understanding bf the structure of mathematics. In many cases, this has . 
resulted in presenting abstract systems formally and then asking children 
to make within that system. It was considered important by 

the author to determine whether the general run of children were capable 
of handling such ideas: 

3. Research Design and Procedure 

Three tests, modeled on an earlier one used by the author, were 
devised. Each test set up the same mathematical system by defining an 
operation a*b - a + 2b, on the set of zero and the positive Integers. 
^Children^were tKen required to make deductions about the truth or falsity 
ot the statements in the test items. The it,ems are shown in Table 1. 
*< 

Table 1 , , ; 

Test Items Elementary Mathematical Systems 



Item , Test 1 Test 2 



Test 3 



\ " - 6*4 t^Tismn - 8976*4728 ' 

2 a*(b*c) - (a*b)*c 5*(4*6) - (5*4)*6 982*(475*638) - (982*475)*638 

; a*x - a 4*5 - 4 .4932*8742 - 4932 

4 a*(b+c - (a*b)*c 3*(4+6) - (3*4)*6 6836*(935+2397) - (6836*935)*2397 

5 a-f(b*c) « (b*c)4-a 3+(4*6) ■ (4*6)+3 572+(865*749) - (865*749)+572 
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In Test 1, tho.sub*ject§ wetf^ asked to*tell when the epatements Would be 
true, anH in Tests ,2 and 3 whether the statements were true or ^alse. 
In all three tests, -the response "can't tell" was also allowed. Tests 
were given in the order listed. * " 



In a pilot study 6Ss, two each at ages 10, 13, and i6 were chosen, 
__1 of IQ 120f.'. In t^ie main study 170 boys and 160 girls from schools 
in loweK middle class areas were used. ♦Thirty were taken at each age 
level froiJi"^, 8, 9, . ; 17- years bf age. The* six Ss In the pilot 
study were examirted individually in the presence' ot the experimenter who^ 
Encouraged the.S to express his thoughts verbally. Upon completion the'/ 
experimenter also went back over incorrect test items, as Hell as th.ose* 
the S could^not do, to seft i'f some small amount of help would enable the 
S. to. respond correctly. In the main test, Ss wrote or marked 40'sWers on 
a sheet provided. Each group of 30 Ss at each, age level Was ^ivetn fort^y^ 
minutes to respond to -all test items.' * . ' .w ^ ^ 

Th^^^potheies tested in the stUdy w^re: ^, ;t'\ •* 

• I. (a) responses to items In "a'Xl. tests for Ss beiOw '^ 

r age 16 would show a tendency to ignore thei.' :^ . 

• given niathematical system^and to reason by , , . . • 

' analogy with a famlllar'*system. \ ' ' \ ' " ' . \ ' 

(b) Ss^iincler age 16 ,v«>uld h^tye- little' success-' on 
any o£.-the tests. . ^'v , - ' ^'^ - \ 

. . ^ , /''.."^ ^ ^' ' ' ■ ^' ' 

II. success on. items 1 and 2 in'te^t 1 would te prece4fed 
by succiess in the pat^alleS items in Tests 2 and '3. 

Th^e hypotheses were fomwlated upo4 tiie basis ^of results in prior, ^ 
Studies and the results; 6^: the pil<5rt t^st.# v ' a 



4. " Findings v ' - 

Responses were tabu'late4 according .to age And correctness,. ..Since 
the Ss work was also,v included on the ^espon^e sheet, it was |)ossible to 
analyze theit pattern of 'tHink'ing to some degree. A <jommou approach to 
items iik^Test 1 w^s to ignora. the defined operation^and to substitute* the 
familiar, binary operations ,df + ^r X. Three', other categories of response 
patterns v^ere identified. ?these are Indicated. by the headings ;4>f fT able 2. 
/^ -''^ « ' . '* 

A correct: ^es^ponse to an itep by 60% ofjSs in Qfi age group was 
selected as thJ^^cHt-of^ point „ta» indicate ^Jccass on an Item. Ih ap 
ex|uldlx\ation o/ the datas success pn Tests iTand 3 waa^ generally achieved* 
. b/-age 16. There *v?as also a, marked /trend for a large ^alrt to M made . 
. between yeets^ 4.i*and 16," Items 3 and 5, werfe-' the ones mos'^t readily 
achieved" in fV^'ts 2 and .3 /but for the ^Srf below 16,\it Was suspected 
Djiat thy -achleved a.^c«p«8 by usittg the substitution of ari arithmetic 
' <^'etation and by i^^rlng'the defined syst'ek. / 

' ^ 2A ' . . , • V 




Table' 



TrOportlDrf of S8 In^ Resppns e^Catfesorles'bV Age Gtoup' 

^ Can' t rell / +/x Artenyfs to^Work , ' Work Correctly 
(1) . aubgtltutioa^ With SysCem Wlth^Systei 
:00— ^ % Defined 'OV . Defined <A) 

15 « .03. .68 • . '29 ^ 

.0*9 ' .80v ' . 

13 . ' .10-' ' . .'87 

-^U •,i)3 * .94 

Jht ' : . .8^^ -ioo . .00 

^^ ' • • .83, • , .00 • .06 

I' ^-oo . ^ .-00 ' ' * ' .00 

.'00 

•00 ' .00 



*.oo 

11 ' .00 
03 , . • " .QP 
.00 :03 



S ^ .27" *i .73 . \00 

7 ; - 1.00 . .00 ' 



The results of the 16 and 17 year olds indicated tha't Uene 1:2.- 
and 5 were achieved before Items ^2 and 4 in all thjee testJ. Item A.^in 
general, tended to be the most difficult. It wad also fouiid that in 
these ^e groups, ,the percentage of successful Ss on Items 1 and 2 of. 4 
Tests 2 and 3 was l^igher than On the «ame tiunfcered items of Test 1, This* 
was particularly true for age". 16. - 

5.^ Interpretations ' » * 

, The findings seemed to support the hypothesM. The findings also 
showed the extreme difficulty Dhat eventhe oldest Ss ha4 in working ' 
within the abstract system in Test 1; it was. not likely that .they could - 
relate the items on that tes^ ta other items in a different teat until 1 
they had command of the items in the original test. Only some of the 17 
year olds^ref^rred back to Test 1 when working on^tests 2 iid 3. The . • 
author wondered about the sequencing of the tests, hypothe^izixig that ' 
the order Te^t 2, Test 3, then test 1 gdght provide the Ss some training 
that they could Use to bett^x? achieve o^ Test 1. , . . 

Th? moat important Mpe<?t front the cdiicational psyAologlst's point ^ 
of yi^ is. the fact that over 80J^ of each age group f »om 9 to 14 completely 
ignored the ^Iven systeta with its defined operation and turned fo a 
familiar oper^tiott. Perhaps the S Is Incapable of manipulating the 
propoaltions that contain the data, but rather iool^ f pr .and works with 
wh^ appears to. him to be the reality of the sitij^tion. 



Abstractor's Notes 



In general, % feel the study was carifully done and the results well 
analyzed. In a study of this type I mlght'offer tlfe suggestion to future 

ERIC ' • • "^-^ 



researchers to consider some type 6f sequential testing. 



For ejfjjunple, 

.rather than test Ss at each age level, consider testing only 



: pimple, 
7,\^rand 



17 year olds. If no great differences occur, as nsJLght bd expect^ 
between 7 and 12, do no further testing of Ss between t\\9Be ^ounSp, Whgn 
differences occur as between 12 and 17, try an intermediate st^Asuch^ as 
age 15 and thpn repeat the analysis. This would have been warrantiWd in 
this stxidy in view of prior research and the results of the pilot \^tudy. 

• In view of the available research and the findings of Piaget aid his 
ass6ciates, the results of this study were nop at all surprising. * Never- 
theless, I would have b^en more comfortable with the authors findiflgf and 
conclusions if he had divided his subj^ts and used an alternate '&b^ tract 
system and/or alternate, set of test items. Thus, one could be reassxired 
that the results are not due to the make-up of the test an^ its 'patticular 
items. • . , " • ' j . : 

Finally, I wonder whether the dramatic: increase in sutCess from age 
15 to 16 on the test ,i,teto3 is^a ref lectiofn'Oi thd Ss' maturtng into the 
formal-qperational stage^ or ju«t ^^i^^ply due to the historical fact that 
they^ have recently conjple^ed a high's5hool course ^in Algebra. Bu^ per- 
haps th^ latter is* a cause of the former* 



James' H* .^Soser j 
University bf Wiscoi&in^ 
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STRUrtURAL MODELS FX)R PREDICnlV^JgE DIFFICULTY OF MULTIPLICATION PROBLEMS. 
Cromer, Fred Eugene-, Jouimal for Research in Mathematics Educati on^ v5 n3. 
ppl55-166» May 74, ' ' ' 

Des^cVlptors— *Algorlthms, *Elementapr' School Mathematics, 
*M^tiplication, *Re8earch, *Task Analysis, Complexity Uvel, 
Lealrnir^ Difficulties. 

Expanded Abstx^act and Analysis P^repared Especially for I.M.E. by Harold L 
Schoen, The University of Iowa. ' ' ^ 

1. 1 Purpose • ^ 

J To te^t the feasibility of using, structural models constructed by. a 
least-square method to predi-ct the difficulty of two-factor multiplication 
probleito. In particular, "the study was directed toward (a)- exploring the 
correlations between each of [several} structural 'yariables and the 
criterion variable, (b) testing the significance of various regression 
models, (c> searching for a more parsimonious model that would still pre- 
dict problem di^icplty, and (d) testing the significance of the inde- 
pendent contribution of 'each of the variables in a model." 

2. Rationale ^ - ^ 

f t 

|This study is based on the research of Suppes 'and others in. develop- 
•ing a process" model ^or arithmetic." In this model a small nunber of 
structural variables and multiple linear-regression techniques were used 
to asses4 the difficulty level of simple addition problems. In kddi^ion, 
a reviftjy of the literature concerned with difficulty level of aritKmetic ^ 
prob-lems was conducted in or4er to identify salient structural variables. 

In general, these studies found that larger' addends or factors in<5rease 
difficulty, combinations with zero are usually at a high level of diffi- 
culty, combinations and thg^r reverses are not equally difficult, 
combinations with the smaller addend or factor second tend to be less * 
difficult." 



3- Research- Design an d Procedure 

" : — ' ■ • ♦ 

/ 

Only multiplicaiQlon problems of t)ie form 

' ab ' . " 

wctd ui^ed in this study where ab af!d cd are twi digit vholti nunhexis. 
Thirteen structural variables were chosen as predictors for the criterion 
variable, iteir difficulty ' (DIFI^) , i.e., the proportion of stfi-ients faiHng 
to arrive at "the correct splution to the item. The structural variables 
were (1) the tpns digit in. the first factor (TDF) , (2) the udlU digit" in 
the Jirst -f^ctot (UDF), (3) the ten^ digft in the seQond factor (TDS) , 
(4) the. units digit in the second factor (UDS), (5) the tmaher of operation 
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steps' in addition (OA), (6) the number of operation s^eps'^n multiplication 
(OM), (7) the number of digits carried in addition (DCA), (8) the number 
of digits' carried in multiplication (DCM) , (9) the largest" digit JLn the 
factors (LDF), (10) the smallest digit in the factors (SDF) , (11) the uumber 
of digits in the product ^NDP) , (12) whether either of the factors had the 
same tens i^nd units digit (SMD) and (13) ^Aether the s'econd factor was 
larger than the first factor (LFS) . The measurement of OA was defined in 
the same manner as the number of operations (0) used in the studies con- 
ducted by Suppes, mentioned earlier. The number of steps in multiplication 
(OM) was defined in a similar way. Briefly, OM reflected the total nunber 
* of binary operations the subject must complete to solve (ab)x(cd) by the 
usual algorithm. 

The sample consisted of 238 fifth graders, all of the fifth-grade 
children from two elementary schoo^ls in a mid-south -Qity of approximately 
25,000. Two forms* of an instrument, each containing 84 nmltiplication 
problems formed from digits generated randomly by a computer, were con- 
structed. One-half of the students completed Form 1 of the test and the 
other half completed Form 2. The test was adainistcred by the classroom 
teachers, ait their convenience, and with no time limit specified. 

Linear models using (1) all 13 variables, (2) the 4 digit-type 
variables (TDF, UDF, TDS, UDS) , (3) the 9 process-type variables and 
(4) 3 variables determined by a factor analysis were cons^idercd. 

i 4. Findings , ^ * 

Jhe sunoary tables for the four linear models arc reproduced below. 
In model 4, OM, OA and NDP were used as predictors since they were the ^ 
variables n»st highly correlated with three factors identified by a 
principal axis factor analysis with projuiax rot*tl,on8. 

MODEL (D— FULL MODEL WITH ALL 13 PREDICTORS 









Percent of Independent 




Probability 


Predictor 


Beta Weight 


B Weight 


Variance Contributed 


F Ratio 


^ I^vcl 


TDK 


.075 


, .P03 


0.2 


1.26 


.262 


UDF 


.273 


.010 


2.2 


15.33 


.000/ 


TDS 


.226 


.008 


1,0 


7.09 


.008 


UDS 


• 187 


.007 


1.4 


9.57 


.003 


OA 


• 376 


.028 


1.9 


12.86 . 


.001 


OM 


-.288 


-.014, 


0.5 


3.19 


.072 


ncA 


-.163 


-.023 


0.5 


3^51 


.059 


\ DCM 


.275 


.035 


Q.l 


3.69 


.053 ' 


LDF 


.097 


.007 


0.4 


2.74 . 


.096 


SDF 


.122 


.008 


0.3 ^ 


2.25 


.132 


NDP 


.216 


.033 • 


1.3 


8.59 


.004 


SMD 


-.156 


-.042 


2.1 


14.62 


^.000 


LFS 


-.005 


-.001 


0.0 


.00 


' .949 . 



Regression Constant ■ -.131* 
Multiple R -..88. - .78. p - .000. 
Note. -For all F ratios, df - 1/15^. 
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MODEL (2)— 


DIGIT TYPE VARUBLES 

r 




y 


Predictor 


Beta Wafght 


— f r 

Weight 


Percent of Independent 
Variance Contributed 


F Ratio 


Probability* 
Level 


TDF 
^DF • 
TDS 

UDS • ' 


.210 
.477 
.503 
.391 , 


.008 
• .017 
.018 
.015 


4.3 
22.7 
^25.Q 
15.2 


22.58 
118.49 
130.45 

79.40 


.000 
.000 
.000 
.000 



-.063. 

Multiple R « .83, r2 . .69, .p - .000. 
Note. -For all F ratios df - 1/163. 



MODEL (3)— PROCESS TYPE VARIABLES 



Predictor 


Beta Weight 


4 

Weight 


Percent of Independent 
Varlflmce Contributed 


F Ratio 


Probability 
Level 


OA 


.423 


\.031 




-2.5 


15.29 


.000 


OM 


-.408 


-.020 




1.1 


- 6.67 


.010 


DCA 


-.181 


-.026 




'0.6 


4.02 


.044 


DCM 


.509 


\ .664 




2.6 


15.95 


.000 


.LDF 


.254 


.018 ^ 




5.0 


30.71 


.000 


SDF 


.249 


.016 . 




1.8 * 


U.03 ^ 


^001 


NpP 


.272 


.044 




3.2 


19.88 


• .000 


SMD 


-.157 


-.042 




2.3 


13. #7 


.001 . 


LFS 


.021 


.004 




0.0 


.25 


.627 



Regression Constant - -.149. / 
Multiple R - .86, r2 ^ .74 p .OOp. 
NoUe. -For all F ratios df « 1/58. 



MODEL (4)— FACTOR ANALYTK? MODEL 



Predictor 


Weight 


V Percent of Independent 
Weight^ Variance Contributed 


« 

F Ratio 


Probability 
Level 


OA 


.318 ^ 


.023 5.4 


22.28 


.000 


OM 


.338 


.017 ^ 5.5 


22.61 


. .000 


NDP 


,245 


.039^ 3.5 


14.68 


.000' * 


Regression Constant - 
Multiple. -R - .78, r2 
Note. -For all F ratios 


-.048. 

- .60,' p - .poo. " 
df - i/164. 
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5. Interpretations 

Of the I3 stmctural variables, only SMD did not correlate signifi- 
cantly with DIFF. Each of the four linear models accounted for a signifi- 
cant proportion of the -variance in DIFF. However, model 1 accounted for 
significantly more of the variance in DIFF than did any of the three 
restricted models» "Thus, in arriving at a more parsimonious and possibly 
more useful modfel^ some predictive power may be sacrificed/' 

This study supported most conclusions drawn from early work on problem 
difficulty with two notable exceptions. First, this study does not ' 
Support the concltision that multiplication problems *with the smaller 
factor second are less difficult. Second, conijlnatlons involving 0, or 
the larger digits, did not prove to be more difficult nor were combina- 
tions involving' "1" or "2" less difficult. In fact, coni)inations 
involving "0** wer6 among the easiest problems to solve. 

The results of this study Clearly indicate that it is possible 4^0 
predict the level of difficulty of multiplication problems in terms of 
easily measured structural variables. Furthermore, the techniques used 
to measure problem difficulty in this study, may be easily e:{ctended to 
different typfts of mathemat^^cal^ problems. Since problem difficulty jls 
one obvious external variable to be considered in building a theory of 
mathematics learning, the measurement techniques used in this study could 
have' Important, theoretical significance. ^ 



Abstractor's Notes 

This research report was written In an exceptionally concise manner, 
in pa/tlcular» its relationship to learning theory and earlier research 
is evident, thou^ it appears to be unduly limited in scope. For example, 
would it not have been possible to analyze the performance of individual 
subjects or types of subjects grouped by some leamor characteristics? 
Basic research which goes beyond analysis of larg^ g?ovp data is deeded 
before any theory of mathematics learning will approach completeness. 
Perhaps the greatest contribution made by this stu^y is the technique 
for measuring the varibus s^r^ctural variables. 

Harold L. Schoet^ 

The University of Iowa 
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LEARNING ACHIEVEMENT AND "THE EFFICIENCY OF LEARNING THE CONCEPT OF VECTOR • 
ADDITION AT THREE DIFFERENT GRADE LEVELS. Gubrud, Allan R. ; Novak, Joseph 
Science Education . v57 n2, ppl79-191, Apr/Jun 73. 
Descriptors— *Concept Formation, *Instruction, *Learuing, Ueaming 
Readiness, *Mathematics Education, Educational Research, Learning 
Theories, Secondary School Science, Sequential ^eo-ning, (Research 
Reports] 

Expanded Abstract and Analysis Prepared Eepecially for I.M.E. by H. Laverne 
Thomas, State University of New Yolrk, College at Oneonta. 

1- Purpose I 

The purpose of the study was to test Ausubel's subsUmption learning 
Qieory. The specific problem investigated was that of finding the appro- 
piTtate grade level for teaching the concept of non-alg^raic vector 
addition. Primary constraints were that learning time to be held constant 

ibV each grade level and that " the initial information learned should 

be incorporated Into cognitive structure with enough clarity and stability 
that it can be usefully employed by the learner to leai?i subsequent but 
related material 

Two research hypotheses were specifically tested: 

1) "Tenth grade students will do better than eighth grade 

students on a posttest following instruction on non- 
algebraic vector addition.^ 

2) Tenth grade students will do better than eighth grade 
students on a related materials test following further 
instruction on material related to non-algebraic vector 
addition. 



2. Rationale 

The investigators were motivated by consideration of Bruner's well 
known hypothesis on concept learning and its limitations in the classroom 
setting. The learning theo'ry of Ausubel provides additional restrictions 
on Bruner's hypothesis in that it posits a strong relationship between 
learning And the availability in the learner's cognitive structure of 
appropriate subsuming concepts. From this a test for adequate learning of 
a particular concept is derived as the degre^ to which it facilitates the 
learning of subsequent related material. 

This research is indirectly related to research on advance organizers. 
It is also somewhat related to a host of studies indicating the feasll)ility 
of teaching a given concept at a given (lower than usual) grade level. 
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3. Research Design and Procedure 

The experimental groups consisted of 96 students from each of grades 
8, 9, and 10. All subjects were selected from the school population in 
Ithaca, New York, a college town of 25,000. Eighth and tenth graders were 
volunteers who took part in the study during study hall periods whereas^ 
ninth graders participated as students in a general science class. The 
IQ range for the 288 subjects was "100-150. ^ 

All Subjects r'ecei^ed an instructional sequence of four 40-mlnute , 
lessons Jn four cdnseciitive days» leading through the addition of vectors 
in lessons 3 and 4. '^xs sequence was standardized by an independently 
developed self instructional system making use of multiple learning 
materials. - * 

Following this instructional sequence an 18-item Pqsttest (FT) was 
administered to one-fourth of the subjects at each 'grade level at inter- 
vals of 3, 21, ^and 42 days. The FT contained nine items on recall of 
rules for vector addition (drill) and nine items requiring the abstraction 
of giving a vector representation of a physical situation as well as 
•applying the rules for vector addition (application). 

The remaining one-fourth of the subject* at each gr>ade level 
received an additional lesson on the resolution of vectors into com- 
ponents and a Related Materials Test (RKT) on this le^^. This occurred 
42 days after the initial four lessons were complete<L| The instruction 
was a programmed booklet for which 25 minutes were alfOt^d with 15 ^ ^ 
minutes for the 12-item multiple choice Related Materials Test. ,^ 

f « 
Dependent variables were the Fosttest and Related Materials Test 
scores. Apparent independent variables were grade level, retention 
interval, and ability level. ^ 

Graphic comparisons on mean FT scores werCi made for ea<ih component; 
drill, application, and for the total FT scores for each grade level. 
Similar comparisons were made between low ^d high ability gtudents at 
each grade level. Factorial analysis of variance was also carried out 
for each of these sets of scores using Grade (3 levels). Time (3 levels), 
and Ability (2 levels, as measured by IQ) as the independent variables. 

^For the RMT, graphic comparisons were made on mean scores by grade 
levei and by three levels of "abstract thinking ability." Contrasts were 
also given between FT and. RMT mean scores by ability and graJe level. A 
factorial analysis of variance was done for the RMT scores with grade 
level and ability level as the independent variables. ^ 

* # 

4. Findings 

The ANOVA for the FT and^ each subtest (drill, applications) yielded 
Significant main effects for grade level and ability level (pl^.Ol). A 
significant main effecjt for retention time was found on the FT and the 
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drill subtest (p <^65). There were no significant interactions. For the 
RMT the ANOVA showed a significant effect oiUy for gr^de level (p<.01). 
These statistical results, together with the extreme differences in mean 
scored between grades eight and ten were reported as supporting boih 
research hypotheses. 

* * ' * - 

* 

5. Interpretations ' 

The investigators argue in several ways that the results pf the study 
are supportive of Ausiibel's subsuii5>tion theory. First, tjie superior per- 
formance of the tenth graders on the Posttest is explained by the greater 
, availability in cognitive structure of relevant subsuming cctficepts. In^ * 
formal investigation tended Co rule out an alternative explanation tihat 
students had learned specific concepts o£ vectors and vector addition Xn 
the interval from grade eight to grade ten. 

Second, the further superior performance of tenth graders on the RMT , 
is explained ih a cumulative fashion based on subsumption theory. That ' 
is, tenth graders possessed through cognitive growth relevant sul^^sumers 
that e^nabled them to learn the initial material vith ereater clarity and. 
Stability hence facilitating the learning of the related materials.^ 

"Third, it is noted that differential effects on the PT scores. appear 
that may be explained or predicted by subsumption' theory . The dlffereoce 
between mean scpres ori the Pos^^est for high and low^ility ninth graders 
1^ A. 9 as compared with 2.2 and 3.5 for eighth and tenth^graders , respec- 
tively. The interpretation is that most high ability ninth, graders have 
a greater availability of relevant subsuming concepts through their study 
of algebra whereas'^mosU low abUity ninth graders do not study algebra. 
This* is further supportecJ by an increase in mean score from eighth to 
ninth grade of only 0.1 for low ability students as coii5>ared with an in- 
crease of 2.8 for high, ability students. ^ 

The fact that a significant difference occx^rs between ability levels 
on the PT but not on the RMT^s also seen as explainable by subsumption 
.theory. The hjgb ability student begins at grade eight, with a greater 
number' of subsumers and acc?iimulates them over time at a greater rate than 
does the low ability student, thus performing better on the^PT throughout. 
This difference disappears on the RMT because the tine interval is too 
stibrt (six week8> for* any factors *tp operate other than the initial state 
of the learner and the' effect of the "learning material, in lessons 1-4.' < 

Finally, the tubjects werd further categorized for analysis into . 
three levels of abstract thinkihg ability. These levels' were defined as 
(a) all ei^ftth graders and low Ability ninth gtadcro, Cb) H^igh ability 
ninth graders and low ability tenth gradei?s, and (c) high ability tenth 
graders. GroMp (a) Ufad a mean scoire on the RMT corresponding to, an 
estimated chance, score (3. 61) whereas' groups (b) and (c) had mean scores 
1.80 and 2.81 points above that scbre. Thus, the* criterion for meaningful 
learning as initially stated is nbt met for group (a) but is better met 
by groups (b) and (c). 
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In som, the Investigators conclude that "Ausuljel's contention , that 
the primary facilitation for new leajgjing is the adequacy of relevant 
concepts, is supported by our data." * ' * , 

I 

' . . • > Abstractor's Notes ' 

'■ :• 

Ther^ are a few apparent errors in the original report tjiat may bie 
puzzling to the reader. In Figures 2 and 3, N shoul4 be 216 rather than. 
192 to agree with the text ot the report. The titles fot Figures 6 and 7 
are reversed. In Table V, the nuiii)er of interns for the Related Materials 
Test should be, , presumably , twelve rather than nine. 

This research is of definite interest for mathematics educators 
although carried out in the context of science education. It w6uld 
appear that the only parts of the learning materials specifically science 
related were those that dealt with applipations of vectors. 

Much prior research,^ with little productivity, has been "directed 
towards the effectiveness •of advance organizers in instruction in mathe- 
matics. The research reported takes a different tack in testing subsun^)- 
tion theory op a ipore basic level and 16 thereby of great interest to 
thos^ exploring the application of Ausub§lian' theory Tji mathematics in- 
struction. Despite the contention that the dat^ are supportive of the 
theory, the resulls are so broad and diffus^as to make the interpreta- 
tions obvious on the one hand (th4 gains from the*ei^th to the tenth 
grade) aad somewhat strained on the other (explaining the superiority of * 
high ability ninth graders over those of low ability). What explains the 
narrowing of the gap for high* ability and low ability tenth graders (a.,^^^^ 
gain cf 3.0, the Targes t single gain for any group)? In what way woulpN 
they have attained relevant Subsuming concepts from Jilnth to tentji grvade 
of *fluch magnitude when they have not taken algebra? I ' 

These and other interpretations made would have beetx greatly 
strengthened had significant interactions occurred on the^ANOVA. Ii> 
contrast, why were thel significant •ffects for retention time not dls- 
,cusseZ? Do they have a specific relationship to subsusq^tion theory? 
If ndt, why was this "factor built into the study? ' ' . 

An interesting contribution of the" study is its approach to testing 
feasibility of teaching specific concepts at different^ grade levels. As 
such, critics night argue that the results might have been more favorable 
at grade eight if only a better teaching approach had been used. Further 
studies could incorporate this factor as an experimental' variable. 



H. Laverne Thomas 

State' University of New York 

College at Oneonta 



ERIC 



34 



36 



^ 099 m , EC 061 607 

DEVELOPMENTAL DYSCALCULIA. Kosc, Ladislav, Journal of Leamiirg 
Disabilities . v7 n3, ppl64-177, Mar 74. ' ~ 

Descriptors— *Exceptional Child Jlesearch, *Leaming Disabilities,' 
*Mathematics, *Testing, Exceptional Child Education, Childhood, 
Adolescents, Number Concepts, Definitions, [*Dyscalculia] 

Expanded Abstract and Analysis Prepared Especially for I.M.E. by Nicholas 
A. Branca, The Pennsylvania State University. 



1. Purpose ^ * ^ 

' The purposes of this p&per are to put forth a definition of develop- 
mental dyscalculia to distinguish it from other forms of disturbed 
mathematical abilities and to present the findings of an investigation 
of mathe^iatical abilities and disabilities in eleven-year old pupils from 
normal schools in Bratislava,' Czechoslovakia. 



Rationale 



The concept of developmental dyscalculi'S has not received the 
attention that developmental dyslexia and dysgraphia have.* Evidence is 
> given to support the existence of genetic dispositions for mathematics and 
various definitions of developmental dyscalculia are given. The author 
considers, day calcula to be a much more complicated disorder than past 
interpretations have suggested and defines it as "a structural disorder 
of mathematical, abilities which has its pVigin in a genetic or congenital 
disorder of those parts of tjie brain that are the direct anatomlco^ 
physiological substrate of the maturation of the mathematical abilit^ 
adequate to age, without a simultaneous disorder of general mental 
functions." Factor analytic studies of mathematical abilities are also 
cited to support the author's contention that these abilities are not 
simple and compact and« that it is necessary 'to differentiate between 
several relatively isolated abilities or factors. Developmental . ' 
dyscalculia is differentiated from postlesional dyscalculia, acalculia, 
oligocalculia, and paracalculia and its basic forms of verbal dyscalculia, 
practognostic dyscalculia, lexical dyscalculia, graphics^ dyscalculia, 
ideognostical .dyscalculia, and operational dyscalculia are explained. / 

3. Research Design and Procedure 

A sample of 375 pupils (199 boys and 176 girls)^ selected' 6t random' 
from 14 fifth grade classes in 14 Basic 'schools in Bratislava were admin- 
istered two sets of group tests measuring mathematical abilities. The 
first set consisted of Kalkulia r, developed by the author for research 
purposes, and a modified version of the Minnesota Paper Form Board (PFB). 
The second set consisted of t^sks testing basic arithmetical operations, 
^.sequences, and symbols. Children scoring at or below the 10th percentile 
^ of the score distribution on the group testa were considered failures. 
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After eliminating those students with IQ*s below 90, three groups of 
failures were delineated, those who failed the first set/ those who failed 
'the second set, and those who failed both sets. These 66 children were 
then suboaitted to^a detailed individual psychological and neurological 
examination. The following* tests — numerical triangle, Rey-Oster rieth 
Complex Figure, arithmetical reasoning, digit memory test, successive 
subtraction of 7 from 100, numerical square test, and G-test were Included 
among others in the investigation. 

4. Findings ^ » 

In the numerical triangle test th"^ groups with global failures 
differed significantly (at* the .01 level) from bo^ experimental gitoups 
in the nunijer pJ incorrect steps and the' testing C|ma. 
' - » ' ♦ . 

The Rey^)sterrieth Complex Figure did not distinguish between the 
experimental groups. 

On the arithmetical reasoning problems the lowest average scores arfi 
the longest mean time were obtained by the experimental groups who. failed 
in the performance tests. ' - * 

In the digit memory test all expjerimental groups were found to have 
a higher average number\pf incprrect reproductions on both sets in which 
the number^ were presentetis^yerbally . The greatest number of failures 
were again recorded in the^^roup o^^globally failing' children. 

The test of successively subtracting 7 from 100 was ^iven in three 
forms (two verbal and one written perf<^rmance) . As far as number and ' 
range of faulty steps are concerned, the poorest results were achieved by. 
the two experimental groups who failed tall the nu&erical tests applied in 
the screening. 

The numerical square holds a special position in the test battery 
used insofar as the poorest result^ were not attained by the group of 
global failures' but by the group that failed only the tests of numerical 
character used in the screening stage of this investigation. 

The G-.test was included in the test battery chiefly to determine to 
what extent dyscalculia (numerical dyslexia and dysgraphia), occurs 
simultaneously with literal dyslexia and dysgraphia. The lowest scores 
were obtairled by both experimental groups who failed in all numerical 
tests employed in the screening stage of the investigation^ 

Out of 15 children of the group of global failures, 11 children 
showed at least gtave suspicion af an objective pathological neurological 
* finding, whereas irt the group of 21) children tfiat failed in the numerical 
tests only, neurological deficits were found in just two cases. In the 
last gtoup (failuxe in the performance tests) there was not a single case 
with even a suspicion. of an objecti^ve pathological neurological finding. 

36, * 




Out of the whole sample of 375 children, dyscalculia was found in a 
total of 24 (6.4Z). 



5, Interpretations * ^ 

The author's definition of developmental dyscalculia, is more iilcJLusive 
than earlier definitions and takes into account the rolationship between 
general mental abilities and special mathematical abilities. 

The research findings illustrate various dif-ferences in children's' 
mathematical abilities. Ihey suggest that approximately 6Z of children of, 
a normal population can be expected to have symptoms of developmental 
dyscalculia as defined in the study. / 



Abstractor' s Notes " ^ 

' 0 ** 

The author has undertaken an ambitious study to collaborate his 
definition of developmental dyscalculia. The paper is^extremely informa- 
tive on a superficial level due not to the study itself but to space 
limitations in reporting it. Jlot all tests are described in detail and 
some used were experimental versions. The author stresses that. detailed 
analyses of the subjects were performed and individual case stales were 
undertaken b/efore the presence of developmental dyscalculia c^ld be 
diagnosed. He reports that school majrks, indicators frqm parents' and 
teachers' questionnaires an<J neurological examinations were statistically 
analyzed but that it is not possible to quote theA' all within the frame- 
work of the paper. The data, however, are available from the author on 
request J 



Nicho^Las A. Branca ' 

The Pennsylvania State University 



37 • 



ERIC 



39 



ZJ 092; 098 \ , , ' .^^ . , . r ' '*AA 517 522 

LEARNING AIDS IN rTHE CLASSROOM; .mERIMEN7;AL EVIDENCE OF THEIR EFFECTIVE- 
NESS. Kuhfittlg, Peter K. F. ^ -Education, v94 n2, ppl35-136, §ov/Dec 73. , 
Descrfptora— *Infltructional Materials, *Lea2ming Processes, 
^Achievement Tests, *Retention, *Eaucational Experiments, Student 
^ Ability, Transfer of Training * 

.* • I . ' • 

Expanded Abstract and Analysis Prepared Especially for I.M.E. bV Larry K. 
Sowder^ Northern Illinois University. 

1. ^ Purpose • " ' ^* . ♦ 

To investigate the effects of concrete 'aids, o^ a dip^covery' method, ' 
and of the interaction between these two^ variables. .• k-* ^ 

2 . Rationale^ ' * . . ^ • 

No research which 'simultaneously investigates ^$>ncrete aids and 
discovery learning seems to have b^en done." i 

/ ' 

3. • Research Design and Procedure * ** • .. 

Four^ factors , each at 2 levels were u^jcrff^ 

^ 1. learning aids (LA)— preflPnrft/aKQonn^ r.f ^^Vt^T^o^o \ * * * 

2. discove^ (D)— fhfiermedlsftre guidance (**-a carefully strudtured. 
sequence of qu^stions'O/maximaJk^idance ("careful explanation of the 
individual steps ); . . ^ ^ # 

3. ability (A)— high/lcJW, based^6n departure pf at least one 
standard deviation frdm the mean on Metropolitan Achievement subscores; 

y> ^ * t_|8ts;— posttest/tfetention test. 

' • , * * 

These factors were the basis for a coi^letely crossed, balanced 2x2x2x2 
' factorial design with repeated measures oh the tests factor. *^ 

; ^ Subjects were 40 seventh-graders, 20 at each ability level; random* * 
assignment of Ss at each level gdte 5 Ss per LAxDxA cell. 

" * . * * * 

The learning 'task was conversion from American to* old English 
currency and vice versa. The concrete aids wera. experimenters-produced 
modiels of coins. Instruction to the 4 LAxD groups was «iven by Ep over- 
head transparencies were used "to insure uniformity of content and to 
help prevent an unintentional bias toward confirming the hypotheses." 
That the treatments were different was established by a 'review of auciio- 
tapes of' the sessions. . ' ' 

Two days of instruction were followed by 2 days of posttests. Af ter 
4 weeks, the same ^ tests 'were giveiv tor retentit)n measures. The tests 
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consisted of 3 parts: acKieveroent. horizontal transfer , ani vertical 
transfer . Reliabilities of. .82, '.84, and >p^y respectively^ were reporjted 
(the type of reliability was not given). Use of concrete aids was not 
allowed during tKe tests ^ 

* ■< ' " ^1 

4. Findfngs « * ^ ' . ' 

1. For low ability Ss on^posttest achievement *score: 

v^t^crete > abstract. (Nonsuch difference w^ noted for 
high^ility Ss.) . . / . 

2. For intermediate guidance Ss on posttest transfer scores: 

concrete > abstract. (No such difference was noted for 
maximal guidance Ss . ) • - • / * 

• 3. Trends i^or- posttest vertical transfer score: ^. 

"^nterm^diaCe guidance > maximal guid^ce for low ability 
(n'ot so for yfi^ ability),. ^ , > 

ll^ 4. The only significant differences ^n retention, test scores: 
^ high ability > low ability on achievement and vertical 

transfer. 

5. For achievement and vertical transfer sccrres: 
posttest > retention t>e^t. 

^5._ Interpretations , • ^ 

* **The main conclusion, then, i^Jthat low. abilifty subjects benefit 
from aids more than high' ability subjects in mastering abstract skills* 
Furthermore, students learning by di8j.6v:ery lAanefit from concrete aids,, 
but whenever th^ expository method is employed the, benefits 4^r4.yed frcQ 
Such aids are not apparent when transferring Che acquired skJLlls to nove). 
situations. Finally, for low .ability si!b3ec,ts intermediate guidance 
'appears^ to be p^eferablfe* on tr^ansfer."' ^ ,r^j 

' . « * 

Abstractor's Notes • " * 

1. The investigation of tl)e joint influences^of "discovery" learning 
and concrete aids makc^ this a most interesting study. In particular, 
there has. been, a ladt^. of work on whether concrete aids with secondary 
school Ss make any^ ffif farence* The experimenter was vise to use the tetms 
**rtitennediate^ guidance" and "max±m4l guidance" and mi^t well have avoided 
the ill-dj^ffned- term ^'IJl^ao^eiry". altogether. , ? 
/ ^ * , ' • • . ' - ' 

. l.\ j:he necessary^ brevity of journal articles is likely responsible 
'f« tjie'j^ack of definitions, of horizontal and vertical tranter (or sample 
test it'(6ia8.'to iiltlstrate* these), information on the scores reported (means 
of ^aw .scores?, pepcenks?), and a more complete report of the statistical 
atialyse?, ^ ^ * • 

.... V ^ . . Q 



1^ The small a, (5 per cell) should cause considerable concern. ' 

Brides th^ sMtistical drawbacks, an ^^o££-day" or misunderstanding by 
only 1 or 2 ^s could cause distortions in results. 

: \ . • • / 

'4/ Coupled with the siHall n^ the 2~day testing migh( have lead to 
this remarkable result iCr^madcable at least to the abstractor— <he exj^eri- 
oen^ter did not conment on it):. For the low ability, intermediate 
guldance,^ abstract group, posttest mean on horizontal transfer - 37.0, 
but detention test mean - SS-S./"' > i ^ . • 

5. The. ab^tractorlis biased against a repeated measures design for 
settings like, that of tnts. study, fie would prefer AKOCOVA (covariate^: 
t&e Metropolitan scores fmd/or the posttest scores), or a multivariate 
analysis, or even separate ANOVAs for posttest ^d retention scores. 
The author did not comnent oa the. apparent dubiousness of homogeneity 
assumptions. ^ v ^ ■* ^ ' * 

• * • • 

i6# The author's statements given above under Interpretations seem 
much stronger than the number of significant differences warrants. 



Larry K. Sowder * 
\/ Northern Illinois University 
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PERSONALITY AND PERFORHANCJ! IN ELEMENTARY MATHEHAHCS WITH SPECIAL 
REFERENCE TO ITEM TYPE. Lewis, D. G. ; Ko, Peng-Sim, British Journkl of 
Educationa l Psvchblogy. v43 ptl,- pp24-34, Feb. 73. J \ 

„ Descriptors— *Personalil;y Assessment, *Secon<?ary School Mathematics, 
♦Performance Factors,, ^Objective Tests, *Item Analysis, Individual 

- Characteristics, Sex Differences, Analysi53 of Variance, Tables (Data) 

Expanded Abstract and Analysis Prepared Especially for I.M.E. by Marilyn 
N. Suydam, The Ohio State University. ' ^ * ^ > 

1. "Purpose ^ * ' 

• « ' • ^ 

to ascertain the relationship between personality factors and 
mathematics performance as evidenced by tfecondary-s'chool students on . 
varying types of test itens. 

,Z. ELationale 

'TJie use of objective tests to supplement more traditional kinds of 
questions has increased. The relationship betvgen such non-cognitive 
.factors, as personality and academic success haAeen studies, based on 
the assumption that students with different personality characteristics 
will respond 'differentl/ to tests; the possible interactive effects of 
personality variables with item type has been noted. Little attention 
has been paid to these effects in a mathematical context therefore 
this stuciy is an alteapt to ascertain the effect of personality factors 
on attainment on various ty'peB of math&natics test items at the Certifi- 
cate of Secondary Education -Level. ' 

3. Research Design and Procedure 

Students aged 14-16 years were selected from two modem s«cond/ry 
schools (one boys*, one g^rls* school) and one coeducational comprehen- 
afivc school. They were initially tested on (1) the Junior Eysenck 
Pcrspnality Inventory and (2) Raveii's Standard Progressive Matrices, 
and were defined by (1) as being ibtroverted or extraverted and neurotic 
•or stable, and by (2) "as having hi^ or low ability. Each student was 
accordingly jilaped in one of eigh't categories, and a sample of 80 boys 
and 80 g4jrls was randomly selected from these categories. 

'The mathematics tes^were constructed in four sections, each 
uaing a distinctive item type: multiple-choice, data-sufficiency, 
multi-facet (true-false), and traditional (constructed response); each 
section was divided into two content areas, nun^er and 8|5acte. 

Data were analyzed by a six-way analysis of variance, taking account 
of a double-crossing of a nested variable, that of individual pupils 
crossed with item type and content areas, within each of the cross- ^ 
classificaUofis^of extraversion^, neuroticism, sex, and ability. 
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4. Findings 

The AOV separates 63 distinct' sources of variation, 60 of which are ^ 
of possible psychological interest; of the 60, nine were found to be 
statistically significant (two main effects , five first-order inter- 
actions, and two second-order interactions). 

(1) Extraverted boys performed better than introverted bcfys in 
all four item types; this was statistically significant only for miilti- 
facet items. Introverted girls perfonned better than extraverted girls; 
this was significant for multi-facet and traditional items. Extraverted 
boys performed significantly better than extraveirted girls in all item 
types except data-sufficiency^ no significant differences were found 
among the introverted. 

(2) !?6urotic children performed better than stable .childretTfor 
number content on multiple-choice, d§tra-suf f iciency , and traditional 
items, while st^le children performed sligjitly better on multi-facer^ 
items; no differences were significant, however. For space content, 
stable children performed better than neurotic children; only the 
difference for traditional items was significant. 

(3) Among the extraverted, those Who were neurotic performed better 
than those who were stable ; "among the introverte<i, stable children 
performed better than neurotic children* Groups with the best perform- 
ances were the neurotic extraverts and the stable introverts. No 

dlf ferenc^^ were significant, although the difference of the differences 
was significant. 

• * • ' » 

(4) Among those with higji ability, the introverted did better, 
whereas among the less able, the extraverted did better. There were 
no significant differences, but the difference of the differences was 
significant. ' ^ 

(5) Differences In ability levels within item type were markedly 
unequal, with that for. data-sufficiency items* noticeably small. The 
overall difference among these differences was significant. 

5« Interpretations 

Previous studies suggested that the advantage of , the educational 
effects of ext ravers ion might be over for this age ^roup, and a signi- 
ficant main effect favoring introversion was hypothesized. This was 
not found. Ext ravers ion- in trovers ion was found to interact with sex 
and item type, thus necessitating separate conclusions for boys and 
girls, these in turn being qualified by item type. Any hypothesis of 
the superiority of introverts survives only if restricted to girls and 
to their performance on multi-face^t and traditional itess. For boys 
extraversion was still an asset. | Thus this suggests that a "change-over** 
occurs earlier with girls. 

\ 




The findings relative to ability level provide aome support for MA 
rather than GA being the real determinant of whan introversion begins to 
be an advantage. • / 

Somewhat in contrast ybo^the linkage of extraversion with sex and 
items type is the extrav^siorv^by-neuroticism interaction. 

Stability would appear to be an asset to mathematical attainment 
only in respect to traditional questions in b space tontent.. 

Further research is suggested to confirm the need to tafee account . 
of the fdrm of assessment of mathematical attainment* 

. ^' 

Abstractor's Notes 

In general, this is . a vjell-presented research report. The review 
of literature is concise but thorough. By and large, the sample 
selection appeared to reflect thfe characteristics of th^ population. 
The mathematics tests.'se;en to have bfen carefully and compet^ently ' 
constructed. (Would the inclusion of sample items have helped to con- 
firm *this react io^i? ) ^ 

Discussloa of the meaning of the findings for schools is not^ 
includ^ (probably because the findings from only one investigation do 
not neAissarily warrant this), ^ut this would be interesting 'to pursue: 
to reflect the highe&t attainment, which item types might be selected 
fot vhich types of students? (Is this an "acceptable" practice?) 

.If supported by subsequent research, the results of this study 
could provide an interesting facet to add to planned researc1%. It 
might be noted in passing that most of the research on this type of 
topic has been conducted in Britain; relatively little has been done in 
this country. Would it be plausible t;o* replicate «uch studies with an 
American population? ' 

* ••' - • -.--^^ ' 

Marilyn «. Suydam 

The Ohio State University 
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AN INVESTIGATION OF OPEN-BOOK AND* CLOSED- BOOK EXAMINATIONS IN MATHEMATlS. 
Michaels. sKlrleyanne; Kieren. T. R. . Alberta Journal of Educational 
Research. vl9 n3, pp202-207, Sep 73. — 

De8crlptor8-*Mathematlc8, *Re8earch Design, *fecores, *Tests. 

*Evaluatldn, Educational Research, Tables (Data), Test Results, 

Data Collection, Predictor Variables 

Expanded Abstract and Analysis Prepared Especially for I.M.E. by Levis R. 
Aiken, Sacred Heart College. 

1. Purpose • 

The following questions wire Investigated: 

1. . Do examinations written In an open-book setting, as contrasted 
with those written In a closed-book setting, provide a different 
assessment of the high school stndent'^^s achievement in mathe- 
matics? That Is. does his achievement differ between the 
/ two settings? 

Does a student's level of, anxiety differ in the two settings? 

Does a student's attitude "^in the two settings differ? 

Is there a relationship among attitude, anxiety and achievement 
in a particular setting? ' 

Does the reliability, validity and varlance^of examinations 
vary between the twq settings? 



2. 
3. 
4^ 

5. 



2. Rationale 



The collective findings from six studies of the use of open-book 
examinations with university students are summarized. - These findings 
t^rl . ^° increase in achievement with oped-book exaMna- 

tlons. (2) Students liked open-book ex^nationa better than closed-book 
examinations, presumably because they were less anxious during the 
former; (3) sounder study preparation resulted from open-book examina- 
tions, (4) students taking open-book examinations were tested not only 
on nemory but also on reasoning; (5) compared to closed-book examinations. 
^Mf^^""" °Pf-book examinations had slightly higher variances, reU- 
abilities and validities. . - ^ ^ * * 



^- Research Design and Procedur 



^*^K s^le consisted of 600+ studentsMn twelfth-gwde 

mathematics classes in Alberta, Canada. Students were randomly assigned 
eroin by classroom lot. Setting and. test forms varied from 

group to group. The following eight scores were obtained on each 
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•student: (a) open-book test; (b) closedrbook test; (c) anxiety (in 
neutral, open-book, and closed-book settings) ; (d) attitude^oward test- 
ing (in open-book and closed-book settings); (e) attitude toward 
mathematics (in neutral setting). The neutral setting involved no 
achievement testing and occurred between the two testing sessions. Each 
of the two parallel tests, one administered as open-book and the other as 
closed-book, contained 36 multiple- choice items. It should be noted that 
the tests used were originally designed for a closed-book setting. 



4. Findings . 

The variance, reliability and validity of the achievement test 
scores did not vary signif icanbly with test setting '(open-book vs. 
closed-book). A three-way analysis of variance (time of administration^ 
X setting X test form) of achievement scores revealed no significant 
interaction between time of administration and setting or between test 
form and setting. Significant differences between the overall means for 
open-book and doced-book scores* were, found for knowledge items, compre- 
hension itenBj and total test scores, but not for application itemsy. 
Analysis of variance of anxiety scale scores across situations (neutral 
vs. open-book vs. closed-book) revealed a significantly higher mean in the 
closed-book than in the open-book and neutral situations, and a signifi- 
cantly higher mean in the open-book than in the neutral situation. The 
differences between meaxis of attitudes toward openr and closed-bo<^ 
examinations were not statistically significant. 

Analysis* of regression of attitude and anxiety on achievement re- 
vealed that the three attitude variables— attitude toward open-'book 
testing, attitude toward closed-book testing, and attitude toward mathe- 
matics — were all significantly related to mathematics ^^chiev^ent. The 
.ahxiety vari^les, however, did not significantly adH to the prediction 
of athievemcttt from the attitude scores' alone. 

5. Inte^retations 

The writers conclude from these results that the open-book setting 
increases scores on knowledge and comprdhenaion items but not application 
items on a mathematics test. The lack of a significant difference for 
application items is interpreted as being due to their complexity, lack 
of relation to specific details, or other factors that make it less 
likely that students would find ready-made answers to the items in their ^ 
notes. 

The findings also 'indicate that anxiety, although still higher than 
in a non-test (neutral) situation, is lower in an open-book than in a 
closed-book situation. Finally, the -Significant correlations between' 
attitude and achievement are interpreted as suggisi^tlng that attitude 
toward the type of examination is predictive of one's achievement on the 
examination. In other words, the differential effect on achievement of 



ERIC 



48 



47 



open-book and closed-book examination settings may vary with the 
examinee's attitude and other individual difference vaViablea; 



Abstractor's Notes 



Ihis was a very interesting s1fudy,n/ith the finding that open-book^ 
examinations produce higher scoreaVith some types of items but not with 
others being especially provocative. Unfortunately, it suffers from » 
several flaws, both methodological and interpretive* Hindsight is 
usually better than foresight, but if I wfere to re-Conduct this investi- 
gation I should use a two by two factoriral design. The open-book vs.- 
closed-book dichotomy would constitute one factor, and the essay vs. 
objective teat dichotomy the other factor. I should alao be more specific 
about my sampling procedure, siixce it is unclear in readlJTg this paper 
whether the. sampling unit was th^ individual student or the classroom 
group. If it was actually the latter, then the subsequent analyses of 
variance areUncorrect^^ Alao^with regard to sampling,, the writers are 
not clear about what they^ mean by the terms *1ieterogeneous" and "class- 
room lot as applied in this situation. 

Educational researchers d?^ct always provide sufficient details in 
describing their research designs, but they usually do a Itit better with 
their instruments. 'Our writers, however, tell us nothing about the nature 
of th6 attitude scales" employed in the present investigation. AaotherN 
possible problem is the fact that the achievement teats were designed for 
an entirely different purpose in another context. These multiple-choice 
tests were designed earlier for a closed-book testing situation only. 

Regarding the analysis of results, I wonder how the writers deter- 
mined that the Spearman-Brown cbefficients for the twc^settings , and 
consequently their reliabilities, were niK significantly different? Con- 
\jgntional statistical tests based on independent random samples were 
inappropriate in this situation because the twq correlations were calcu- 
lated on the same sample o^people* Regarding the analyses of variance 
of the three subscores and total score. on the achievement tests, I would 
have opted for multivariate analysis of variance. Scores on the knat- 
ledge, comprehension, and application items axe undoubtedly positively 
correlated. Alao, tables of means (Table 1) and ANOVA tables (Table 3) 
should be labeled as such. ,^ 

.Finally, the authors get into difficulty «gain in the interprptation 
of their resul;:s. After noting that attitude toward the type of examina- 
tion is correlated with achievement tcorfes, they refer t<J ^e attitude 
scores as^predictors (of achievement). They conclude from this "Binding \^ . 
that there are individual reactions to open- and closed-book examina^tions . 
The last statement is undoubtedly a truism (there are always individual 
differences!), but attitude is not strictly a predictor of adiievement in > 
this situation. Nor has it been demonstrated that differences in attitude 
toward open- and closed-book examinations affect achievement in these two 
situations dif femntially. Attitude was measured after achievement, and 
can be viewed mofe as an effect than a cause of the latter in this 
instance. T » 
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In addition to correcting the shortcomings noted above, the next 
tine around I'd like to see the authors or their intellectual descendants 
' Include pretest measures of mathematics achievement and attitude. This 
way we could see how the differential effects of open- and closed-book 
examinations are related to initial standing on the variables in question. 



Lewis R».Ai,ken 
Sacred Heart College 
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A KINDERGARTEN MATHEMATICS PROGRAM. Runnels, Patricia; Runnels, LK. 
School Science and Mathematics, v74 n5, pp361-365, May-Jun. 74. 
Desci^iptors— *Curriculum, *Elementary School Mathematics,^ 
*K±ndergarten, *Program Descriptions, *Research, Achievement, 
Ability, Accelerated Courses, Gifted, Instruction', Learning 

Expanded Abstract and Analysis Prepared Especially for I.M.E. by Robert 
E. Reys> University of Missouri-Columbia. 

1. , Purpose 

To report Results of a formal preschool mathematics training program 
on mathematics achievement of kindergarteners and a follow-up check 
during the middle of .the first grade. 

2. Rationale 

Considerable growth in basic mathematical concepts occurs before 
formal schooling begins. Such development usually reflects no planned 
sequence of learning activities, whereas this study was based on the 
assun^tion that a carefully structured kindergarten mathematics program 
should produce significant growth in mathematics achievement during 
kindergarten and first grade. 



3. Research Deaign and Procedure 

The sample for the investigation was 17 children from an intact 
kindergarten class. The subjects participated in a six hour kinder- 
garten program for the entire 1971-72 school year. Bach day contained 
three distinct parts of the instructional program devoted to mathematics. 
Two 20 minute segments weife devoted to group instruction (one dealt with 
number skills and the other reflected topics selected from a textbook 
series) and one individual session (between teacher and pupil) of five » 
minutes duration which was also devoted to nxmher skills. 

Levels of achievement with respect to addition and subtraction 
(reflecting the highest basic family fact mastered) were reported. 
Scores on the arithmetic coiiq>utation pnd reasoning subtests of the 
Gray-Votaw-Rogers General Achievement Test given at the end x>f the , 
semester of the first grade were also reported. Th^e data were 
correlated with l.Q. scores, age and sex of the subjects. 

f 

4. Findings ^ 

At the end of kindergarten, all subjects were able to count by ones, 
twos, fives and tens to 100 and could recognize^ numerals to 100. All 
subjects could also show and count correctly any designated nunfcer of 



fingers from 0 to 10. Significant positive correlations (p <.01) werej^^" 
reported between I.Q. and arithmetic computation; and between kinder-, 
garten addition and arithmetic computation in first grade. It Was also 
found that I.Q. and first grade computation scores were' more highly 
correlated for boys than girls. 

5. Interpretations 

/' 

The strong correlation between the kindergarten achievement levels 
and the mid year first grade arithmetic scores is^ of particular interest. 
This suggest^ the predictative potential of selected kindergarten mathe- 
matics achievement scores, ,^^ch information could be used for the early 
identification of children gifted in mathematics and those with special 
learning problems. ^ 

Abstractor's Notes 

The predictative potential of this study holds considerable promise, 
howevar only limited generalizations and/or interpretations can be made 
from this investigation. Any conclusions drawn,and/or implications made 
must be tempered by the following facts reported by the researchers as 
well as several questions which were not addressed in the article. 

The sample was small and not random. It was composed of a total of 
17 subjects, only 13 of which had I.Q. and*first grade achievement scores 
available. These data revealed only one I.Q. score below 100, whereas 
ten subjects had an I.Q,. of 120 or above. This was a group of very 

"intelligent children and would not typify the range of abilities found 

^in most class rootns. ^ * 

No control group of kindergarteners was identified, consequently 
* it was not possible tc( compare the ef f ectivehess of the Kindergarten 
Mathematics Program (briefly described in this article) with a tegular 
kindergarten program. In fact the design of th:^s research did not 
include a pre and post test, component, even though this would have 
provided valuable baseline as well as change data. 

The authors acknowledge the scarcity of instruments for early 
assessment of mathematical competencies of children entering school. It 
is agreed that more iastruments for early assessment in mathematics are 
needed. There are however several such instruments available (such as 
Key Math and the Comprehensive Mathematics Inventor^), yet no rationale 
for not using this type of instrument was given. 

The entire assesspent during the kindergarten year was weighted 
toward number skills; yet many other matheifiatical concepts (such as 
classification) are not only essential but in fact prerequisites for 
many basic number ideas. No effort was made to assess the cognitive . 
levels at which these kindergarteners were operating. For example, 
information regarding the subject *s ability to conserve would be 
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i.nvaluablc. In particular it would be helpful to know if, when and to 
what degree these kindergarteners conserved nuii4)er. The relationship 
between this ability to conserve nunjber and their levels of computations 
achievement would also be of interest. 

In closing it should be noted that this research investigation 
would be justified only as a pilot study and seems of questionable value 
for publicatibn. 

Robert E. Reys 

University of Missouri-Coluicbia 
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NEGATIVE INSTANCES AND THE ACQUISITION OF THE MATHEMATICAL CONCEPTS OF- • 
COMMUTATIVm AND ASSOCUTIVITY. FINAL REPORT. Shunway, llichard J. 
Ohio State University, Columbus. Spons Agency— National Center for 
Educational Research and Development (DHEW/OE) , Washington, ,D.C., 
Regional Research Program.' Pub Date June 72 Grant-OEG-5- 71-0025(509) 
Note798p. EDRS Price MF-$0.65 HC-$3.29 j ' ,->^ 

'Descriptors— *Concept Teaching, ^Instruction, Learning, *Leaming 
Theories, Logic, ^Mathematics Education, Number Concepts, *Research, 
Secondary School Mathematics 

Also reported in: 

NEGATIVE INSTANCES IN MATHEMAtlCAL CONCEPT ACQUISITION: TRANSFER EFFECTS 
BETWEEN THE CONCEPTS OF COMMUTATIVITY AND ASSOCIATIVITY. Shumway, 
Richard J., Journal for Research in Mathematics Education . v5 n4 
ppl97-212, Nov. 74. ' 

Expanded Abstract and Analysis Prepared Especially for I.M.E. by William 
E. Geeslin, University of New Hampshire. 

1. Purpose ^ 

To determine if an ins tructional ^sequence consisting of both positive 
and negative Instances as compared to a sequence of only positive 
instances produces a difference in the acquisiti6n#of the concepts of 
commutatlvlty and associativity. And, if differences exist, to determine 
if the effects of including negative instances transfer from the acquisi- 
tion of one concept to t4ie acquisition of another. 



2. Rationale 

Mathematicians have stated that negative Instances are essential to 
the understanding of advanced mathematical concepts. Some psychologists 
have reccnmended the in^clusion of negative in^stances in the teaching of 
mathematical concepts. However, reviews of research indicate negative 
instances may have a debilitating effect on learning, particularly on 
learning of simple concepts. This study investigated the learning of 
concepts where the concepts were of the more complicated type encountered 
in mathematics. 



3. Research Design and Procedure 

« 

The concepts of commutativlty (C) and associativity (A) were selected 
for this study. The four treatments each consisting of 20 instances of 
each concepts in a fixed but rAndom order, wet6 1) C + A +, 2) C + A +, 
3) C -I- A +, and 4) C + A + (a indicates all 20 instances were positive; 
a + indicates 10 positive instances and' ten negative instances). Treat- 
ments were administered by computer terminal. Each treatment consisted 
of three sessions (approximately 25 minutes 6ach) : pretest, treatment, 
and postt^st, respectively. Randomly selected ninth grade students 
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(N " 64) from one Junior high school served as subjects. Me^n v&rbal IQ 
at the school was 105. Subjects w^re assigned randomly to treatments 
(l6/treatment) and all subjects completed the session within seven days 
(most i^ithin three days). Two pretesrts, calcuXations with parentheses 
and calculations without parentheses, were adndnistered (reliabilitied> 
.80). In addition, total stimulus interval (sum of lengths of time 
between typing of stimulus and entaring of response for each instance) 
'for each subJecX 9n each pretest was recorded. During the treatment , 
ses^on, total stimulqs interval ^d total postfeedback interval Tsum of 
lengths of time between the typing of feedback and the subject's hitting 
return key to receive next stimulus) for each subject on each C9ncept 
were obtained. Two posttests, commutativity and associativity, were 
used (reliabilities approximately .5). Total stimulus intervals and 
total postfeedback intervals on the posttests were recorded for each 
Subject. Multivariate and univariate analyses of variance and covariance 
were used to analyze the data. Analyses ware done separately for each 
concept.. Achievement variables were separated from time variables. 



4. Findin'gs ^ 

A univariate analysis of variance indicated treatment groups 
differed on the calculations with parentheses pretext (p<-05). No 
significant differences between treatments on posttest achievement on 
commutativity were found. Analyses of covariance indicated that inclu** 
sion of negative, instances in the treatment for commutativity caused 
subjects to spend more time responding to items on the posttest foi^ 
^commutativity (p<.05). 

The presence of negative Instances for commutativity and associati- 
vity both increased performance on associativity .at posttestt(p ^ .025) . 
This indicated a transfer effect for the treatment of negative instances 
from commutativity to associativity » The treatments including negative 
instances appeared to have increased the stimulus interval times. 



5. Interpretations ^ 

* 

For the acquisition of the concept of associativ'ity , a sequence 9f 
positive and negative instances was favored over a sequence of all 
positive instances. ' " * ' 

the acquisition of the concept of associativity was improved by 
inclusion of negative instances for commutativity. Transfer occurred. 

Three possible explanations of the results are: 1) negative 
instances are a necess£try and integral part of concept learning; 2) 
ijegative instances teach subjects to be skeptical; or 3) negative in- 
stances te^ch Subjects the proportion of criterion instances that Should 
be classified as negative using guessing. Nonetheless > classroom 
teachers should begin to experiment with the \iae of negative instances 
in instruction. " ' * 
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'>Ab8tractor?8 Notes 



•• Bf f icient ancJ complete ^learning of mathematical Concepts is *an^ 
^extremely Important problem.^, Shunway's study had several nice features: 
-a^good r^vfew.pf the literature^ a complete description of the study, the 
experiment was/controlled well; v'ariables were. defined carefully; 
questionable statistical procedures were noted and documentation for each 
Step Itf the^ analyses was provided; alternative explanations for the. 
Results '^ere given^ .and recommendations to classroom teachers were in- 
cl;ided. The' interested reader should examine both t;Jie Final Report to 
-HEW' as well the JRME airticle/ ^' ' • * 

Th6 low reliabilities. of tlU. posttest . suggest the study should be« . 
replicated before* the results are ,acc3plfed-. Negative instan.<;es increased 
achievement 'on only one of the concepts and tended, to increase tesponsq 
^time o.n both concepts. Th^ educator .is, thus faced 'with the dilenma of 
-whether the incre^^e in drchieVement is?w6Tth the apparent instructional 
time losi3. No clear guide exists as t6 whijch concepts miglit be better 
, taught with negative instancy or whatjthe lopger term eff^t« ciight be. 
'.Transfer seemed^ to occur jnore strongly in the achievement variAles than 
in-lilie' time variables. In 'the case df Achievement, transfer seemed to 
occur in a rather^apecial. case,, I.e., cotntnitTations, on' associativity were 
dependent on computations "on coknutativity. Does transfer occur between 
more independent concepts?. If negative instances help preveijt students 
from over-gene'ralizifig, th.ep th« concepts need"nOt-be so closeiLy related. 
Finally, the tre:4tiD^'t peritJ^ was quite short and administered by CAI. 
It is not known whetKeY the results of th^^study cAn be .replicated in 
the more \istial classrctota setting.' . 

'« , . . *^ '.' ' ^* - ' . 

One last concern is of ' a more general nature, but may reflect oijly 
this "reader's di]eflcuj.ty with the notion of concepjt . learning-. It appears 
that^ubjects could haVe responded Perfectly to thait^t iteni by compu-. i 
tational mfeans alone. To determine if an^operation is commutative, one 
Should rely on a' more abstract form of reaioning ^han compjutation. For 
fxatele, if a*l)'*« 2a + 2b the ardent wdaid be tl^at a*b 2a + 2b « 
^ 2b + 2a'» b*a and' then * is commutative. Has the ^subjject who calculates 
''a*b and b*a and then compares results^ learned tKe ''concept" of conmutati- 
Vity? Future, studies co'ul,d .include items on non-commutative openations 
Whici^ have exaoiples making it appear tlie operation -i^ commutative: e.g., 
a*b' remainder, when a -f 2*, >*i3 « 1 « 13^?^ 4*28 « 0 « 28*4 (but a*b - ^ 
b*a. Secondly, although psych^olbgists use a series of 'examples to 
examine concept foniiation experlmetntally , this i» not a paradigm for 
learning. 'A study 6buld approximiate more closely, the teaching/learning 
*£tuation by preceding (or following) .the series of examples with a brief 
difl'cttssion of the^ concept, :Re8ult& may of may not differ from the present 
stpdy, but would be much more applicable to the 'classroom. 
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ELEflENTARY TEACHERS LEARN TO SEQUENCE MATHEMATICS INSTRUCTION. Sowell, 
Evelyn, School Science and Mathematics, v''4 n5, fip403-406, May-Jun. 74. 
Descriptors — ^Instruction, *Mathematics Education, ^Research, 
*Teacher Education, *Teaching Techniques „ loservice Education, 
Preservice Education 

• 

Expanded Abstract and Analysis Prepared Especially for I.M.E. by Jaiaes 
M. Sherrill, The University of British Columbia. , * 



1. Purpose 

The study was implemented to "design and test a self-instructional 
program for elenientary teachers. Specifically, the p*rogram*consists of 
materials to help teachers select and arrange sequences of behaViorally 
stated objectives." 



2. Rationale . ^ 

The question, "How did you decide what mathematics ypu would use with 
yoor pupils today?", was asked of elementary teachers and graduate mathe- 
matics, education students and the most frequent answer was, 'W did the 
next page in our math book." Sow611 felt that the reply "seems almost 
incredible" due to the increased emphases in recent year^ on understanding 
mathematics and individualizing instruction. Although she feels textbooks 
are valuable resource materials, relying 'on them exclusively deprives^ 
children of manipulative learning experiences. She also states that a 
single source of mathematics information is inappropriate for most class- 
rooms since the ra^e of pupil abilities usually widens 4s the grade level 
advances . 

* I 

3. Research Desifo »^d Procedure 
* ' — ■ 5 

Self-instructdonal materials w5re written to assist teachers irv 
selecting, and arranging objectives ^•.'sequences. The seven sections were 
bases for instructional sequences, Jprenumber ^Sperations, numeration, " 
addition, subtraction, multiplication, and division. Each section 
featured an overview, general goal statements, flow charts containing 
objtttives, explanations (definitions and illustrations of objectives), 
dnd self-checking assessments. * 

A forty item multiple-choice test was developed to assess teachers' 
abilities to select objectives which are prercq^uisite to a given terminal 
objective and to place them in correct sequence. The test, like the 
principles upon which objectives and sequences were based, was validat^ed 
by a group of mathematics education per;^on8. , Equivalent fopns of the 
test Were prepared and the instrument was administered to forty-five ^ . 
pre-servlce teachers resulting in a Kuder Richardson formula 21 co- 
efficient |>f internal consistency of 0.887. 
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.Hater ial^ were used both-witlr pre- .and in-service teachers. The 
saijple oi pre-servic^ teachfers included two sections of elementary majors 
whp <fere enrolled in a mathematics methods class. By toss ^ of a coin one 
VgJ^yP of 31 students became the experimental group (EL) wh^le the second 
group of 30 stud^ts was the control ^roup (Cq). 

No claim for a random sample is m^de for the in-service teachers. 
Twenty-^ix teachers volunteered as the' experimental group (E^) and^ twenty 
teachers from the same school district volunteered as controls (C^). 
Sin ce all of these teachers were Certified, they have credit for at 
least one course* in mathematics education. 
c* 

The pre-tests were administered to experimental and control groups 
oh" the same day. Then coatrol groups continued their regular activities 
while ejjperimental groups studied the instructional materials. • During 
nine^clock hours scheduled for this study, participants worked independ- 
ently ot in groups of their chopsing. ^ The investigator was present as an 
observer at all sessions* Following' the ^tudy, all subjects took a 
post-test. V * 

The means of the post-test scores for Ep and Cp were compared using 
analysis of cova'riance With pfe-test scores serving as the covarfate. 
The same analysis was implemented for -the two in-service groups. 

Findings ^ ' * 

The experimental group scored significantly higher than , the control 
group for both the pret-serVice and the in-service sub jects . 

5. Interpretations , m, 

The materials seemed to achieve' the intended purpose, namely, the 
subjects that used the self-instructional jJcogram were assessed as having 
better "abilities to select objectives which-are prerequisite to a given 
terminal objective and^to place them in correct sequence.*' 

Abstractor's Notes 

s\>well justifiably states that, '*No cliim for a random sample is 
made for the id-service teachfers.** Iche in-service groups were all 
vol^jnteers, which is not unusual for this type of study using in class 
teachers. In Sowell*s study (if the article statement is accurate) the 
teacl)ers didn't just voltinteer to be in the study, but volunteered for 
the particular group they would be in^with 26 in the experimental group 
and 20 in the control group. The experimental subjects were allowed to 
work ^'independently or in groups of their choosing." Questions of random- 
ness of the sample and independence of the data arise concerning the 
statistics used to compare the post-test means. 
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A3 is true o5 many research articles, no examples from the self-^ 
instructional program or the tests .are given. Examples could have shed 
some light on the test, especially ^hen the teachers were asked to 
arrange the objectives to match some pre-determined correct sequence. 

^0 the post-test seems to 'have been a test on how well the 
subjects learned the material in the self-instructional program, a. pro- 
gram the control groupr never saw and the experimental group studied for 
nine hours. r *^ 

The study did, however, successfully design a self-instructional 
program which assists teachers to learn to sequence stated objectives. 
A very important, future study is suggested by Sowell^ . . there 
should be a f oliow-up study to' find out whether teachers who learned 
to sequence instructional activities for pupils will indeed do so with 
their pupils." 



James M. Sherrill » 

The University of British Coltiiii)ia 
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STUDENT EVAL0ATI5n OF MATHE^^ATICS INSTRUCTION. Waits, Bert K. ; Elbrink, 
Larry C. , Two Year C ollege Mathematics Journal . v4 n2, pp59-66, Spr 73 
Descript6rs— *Collejge Mathematics >- *Cour8e Evaluation, ^^Evaluation, 
*Research, *Teacher Evaluation, Instfiictipk, Mathematics Education 

Expanded Abstract and Analysis Prepared Especially for I.M.E. by Phillip 
S. Jones, ^i;iversity^of ^^ichigan. 

o 

1. Purpose 

To investigate whether students* ' evaluations of instructors in a 
college calculus course are biased by the students* achievement in the 
course. . 

2. Rationale 

There appears to be a growing concern for the evaluation of teach- 
ing. Student ratings of teachers are being used to provide data 
supporting hiring and promotion, to provide feedback td teachers on the 
basis of which they may improve their work, and to help students in 
course selection. With such fundamental uses being made of this data^ 
it is important to examine its meaning, validity and implications. The 
authors cite a survey of the literature of teacher evaluation by France^ 
Dwyer as characterizing evaluations as subjective and subject to many 
inherent limitations. They chose to study the extent to which students' 
achievement in mathematics may bias their evaluation of their mathematics 
teachers. The authors felt that this biasing effect may' be greater in 
mathematics than in other fields because manyts tudents view required 
Toathematics courses as unpleasant, uninteresting, and difficult. 

3- Research Design and Procedure 

A SET (Student: Evaluation of Teaching) questionnaire developed by 
^Dr. Robert W. Ullman of Ohio State University was administered to all 
students in the sixteen sections of the second course in calculus with 
economic applications for non-mathematics, nor/physical science majtrtrs. 
The questionnaire contained 48 questions <iivi<led into three categories- 
course, instructor, examination. Approximately half the questions were 
phras.ed positively and about half were phrased negatively. . The students 
selected one of strongly ^agree. agYee. disagree, or strongly disagree 
for each question. These replies were scaled as 3, 2, 1, 0, in that 
order, for positive questions and in reverse order for negative questions. I 
In addition using these factors to compute a tating for each student \ 
in each category, the average midterm score on the departmental examina- * 
tions was determined for each sdudent. • . 

Three null hypotheses were then tested for each section- of the ' 
course. These were the correlation between achievement, defined as 
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average midterm examination score, and the course rating, the teacher 
rating, and the examination rating would each, in turn, be zero. A 
second set of three null hypotheses were formulated £ind tested by classi- 
fying the achievement scores into five groups, using the classification 
as the independent variable and the three rating scores in turn as 
dependent^ variables , and applying one-way analysis of varianc^e. The 
hypotheses were that there was no effect of achievement rank on the 
student ratings. The second procedure was applied to test the possibility 
that there mi^ht exist non-linear relationships which would not be re- 
vealed by correlations computations. ^ 



4. Findings ' • 

The hypothesis that the correlation of achievement with tourse 
rating would be zero was rejected for seven of the sixteen^ septions , but 
the null hypothesis was rejected for only one section in each case when 
teacher and examination ratings were compared with achievement. 

■) 

When the second set of hypotheses were tested using grouped achieve- 
ment scores rather than raw scores the null hypothesis with respect to 
course rating, was rejected for 9nly ^o sections, and the null hypoth- 
eslfiijrLth respect to examination 'i^d with respect to teacher ratings 
waa^ejected in one section for each. No significant relations not / 
iii^lied by* the correlation analysis were implied by the analysis of / 
variance. 



5. Interpretations 

The writers concluded that some teachers can expect to receive 
student evaluations unbiased by *^student achievement, but that other 
teachers will receive biased ratings on the basis of the fact that al- 
though the correlat^ion between achievement and teacher rating was 
significant at the .05 level in only one section, it waS positive and 
near significance in eight others. 

They noted that evaluations of courg^es and examinations correlated 
significantly with achievement (good students giving favorable ratings) 
in about one half the sections. The writers also note that their sub- ^ 
Jective evaluation of their colleagues would lead to the same ranking 
as the SET with a few notable exceptions. They concluded with words of 
warning; xhey could not recommend any evaluation instrument, adminis- 
trators should, encourage student evaluations only after careful consid- 
eration ofc their psychological and local effectd including the possihility 
that te^^ers might teach for good ratings. 

Abstractor's Notes 



The writers' concluding concern for the possible deletetious effect 
of SET*s on teaching is supported by Leon W. Zelby wha reported an « 
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experiment in teaching paired classes by different methods as reported in 
Sci£nc£, volume 183 (29 March 1974) pp. 1267-1270. He felt that heliuld 
manipulate his, SFE (SET) score, improving it by using procedures which had 
a greater appeal to students (especiaiy to the less able students), but 
which were intrinsically less desirable educationally. 

The wrUers* statistical result that there is little correlation 
between grades and student ratings is supported by other studies as is 
also their feeling revealed by their phrases, 'W teachers might expect 
to receive unbiased evaluation ratings - the ratings of some teachers 
will be biased— , In the article by J. A. Kulik and W. J. Keachie, "The 
Evaluation of Teachers in Higher Education? prepared for Review. of 
Research in Education. Vol. -3 (1975) edited by F. N. Kerlinger, a 192B 
study, by Remmers, a 1950 study by Elliott and a 1971 publication by 
Castin, Greenough, and Menge are cited, all of which found overall 
correlation between grades and ratings to be very low. However, somewhat 
deeper analyses tend to sHow that instructors tend to differ, by choice 
or nature, in the level of student with whom they are most effective. 
Hence some instructors may tend to receive better ratings from good 
students and oth6r instructors may be highly rated by poorer students. 
This may explain the marked difference iri the behavior of one or two of 
the sections in tfte study by Waits and Elbrink. A 



Phillip S. Jones 
University of Michigan 
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